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Foreword 


Personal identification represents a central goal of forensic anthropology and asso- 
ciated disciplines that are involved in the study of human remains. Craniofacial 
superimposition comprises one of the tools that can facilitate identification, or 
exclusion. Methodology in craniofacial superimposition has evolved with techno- 
logical advances but remains at the nexus of scholarly activity in anthropology, 
anatomy, image analysis, art, photography, and computer science. Given the diver- 
sity of the academic fields involved and the variety of case applications, it is not 
surprising that techniques and procedures for interpretation vary widely, historically 
and globally. Such variation complicates comparison and understanding of research 
and case results. Clearly the need has existed for many years for a comprehensive 
examination of ideal technological approaches, the science relating to the interpre- 
tation of the key anatomical structures, and the probabilities involved in 
interpretation. 

This volume represents a comprehensive examination of the key issues relating to 
craniofacial superimposition. The information presented results from many months 
of discussions by numerous researchers and practitioners experienced in this field. 
Recommendations relate to all areas of this complex process and provide a template 
for future advancement. Colleagues involved in applications will find thoughtful 
guidelines on technology, anatomical interpretation, and probabilities related to the 
identification process. Researchers will encounter a useful synthesis of the current 
state of the art and elucidation of the areas that remain in need of further investiga- 
tion. All readers should appreciate the tremendous scholarly effort represented in this 
volume. It represents a comprehensive statement on the current status of craniofacial 
superimposition. The book also clearly signals the direction of future research by 
clarifying many of the issues that need further scholarly attention. 


Smithsonian Institution Douglas H. Ubelaker 
Washington, DC, USA 
May 2017 


Preface 


As a researcher in the fields of computer science and artificial intelligence, I knew 
about craniofacial superimposition (CFS) in 2005, thanks to the outstanding achieve- 
ments of Drs. Miguel Botella and Inmaculada Alemán who lead the Physical 
Anthropology Laboratory at the University of Granada (Spain). At that time, I had 
recently defended my PhD, supervised by Dr. Oscar Cordón, who is one of my best 
friends and one of the most brilliant scientists I have known. We both soon 
recognized the potential utility of soft computing and computer vision to assist 
CFS practitioners in many time-consuming and tedious tasks. However, we also 
identified important shortcomings related to the lack of a standardized methodology 
to face such a challenging goal. Unlike other well-established forensic techniques, 
we certainly found a wide diversity of approaches to CFS in terms of the techno- 
logical means employed, the procedures applied, and the protocols considered. 
Together with a PhD student — now Dr. Oscar Ibafiez — we three decided we should 
make an effort to propose an international initiative that could lead to a first 
international agreement on the basics for the appropriate application of CFS. 

This handbook was supported by the European Union’s Seventh Framework 
Programme for research, technological development and demonstration under the 
MEPROCS Project, Grant Agreement No. 285624. It is the main result of the 
European Project “New Methodologies and Protocols of Forensic Identification by 
Craniofacial Superimposition (MEPROCS),” granted by the European Commission 
in 2011. The project started in February 2012 and finished in July 2014. MEPROCS 
aimed to propose a common EU framework to allow the extensive application of the 
CFS technique in practical forensic identification scenarios commonly tackled by 
European law enforcement agencies. 

Furthermore, the inclusion of the most recognized CFS practitioners and labs 
from the five continents made MEPROCS a global initiative beyond the EU borders. 
Even though the initial seed of the project included just 7 institutions from 5 EU 
countries, the MEPROCS network finally involved 31 institutions from 17 different 
countries that actively participated and contributed to the success of the project 
(Table 1). 
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Table 1 Organizations that contributed to the MEPROCS EU project (the European Centre for 
Soft Computing was the coordinating institution) 


Participant 
no. Organization Country 
1 Fuzzy-Evolutionary Applications Research Unit, European Spain 
Centre for Soft Computing 
2 Physical Anthropology Lab (PAL) and Department of Computer | Spain 
Science and Artificial Intelligence (DECSAT), University of 
Granada 
3 European Council of Legal Medicine Germany 
4 Consorzio Ricerca Sistemi ad Agenti (CORISA), University of | Italy 
Salermo 
5 Division of Identification and Forensic Science, Israel National | Israel 
Police, Israel Ministry of Public Security 
6 Forensic Science Centre, University of Coimbra Portugal 
7 Guardia Civil, Spanish Ministry of the Interior Spain 
8 Policía Judiciária, Portuguese Ministry of the Interior Portugal 
9 Council of Forensic Medicine Turkey 
10 Centre for Anatomy and Human Identification (CAHID), UK 
University of Dundee 
11 Laboratory of Forensic Anthropology and Odontology Italy 
(LABANOB), University of Milan 
10 Moscow Regional Bureau of Forensic Medicine (MRBFM) Russia 
11 Vilnius University (VU) Lithuania 
12 Complutense University of Madrid (CUM) Spain 
13 Azienda Ospedaliero-Universitaria di Trieste. Italy 
Unita’ di Ricerca Paleoradiologia e Scienze Affini (AOUT) 
14 Forensic Anthropology Society of Europe International 
Institution 
15 International Academy of Legal Medicine International 
Institution 
16 International Association of Forensic Sciences International 
Institution 
17 World Police Medical Officer International 
Institution 
18 Department of Forensic Medicine, University of Copenhagen Denmark 
19 Forensic Science Programme, Universiti Sains Malaysia Malaysia 
20 University of Melbourne Australia 
21 University Wiener-INML and Public Ministry Peru 
22 North Carolina State University USA 
23 University of Pretoria South Africa 
24 National Research Institute of Police Science Japan 
25 Institute of Ethnology and Anthropology of the Russian Russia 
Academy of Sciences 
26 University of Health Sciences, Rohtak, Haryana India 
27 South African Police Service South Africa 


(continued) 
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Table 1 (continued) 


Participant 

no. Organization Country 
28 Department of Health, City of Moscow Russia 
29 Moscow State Forensic Bureau Russia 
30 Moscow Regional State Forensic Bureau Russia 
31 BARS International Russia 


This handbook includes the tireless efforts of different representatives at these 
institutions. Even though they are not formally considered book coauthors and they 
are not included on the handbook’s front cover — due to the publisher’s rules — we 
consider them coauthors of this nonprofit publication. They are listed as follows 
(including their affiliation at the time they joined the MEPROCS project): 


° S. Damas (European Centre for Soft Computing, Spain) 

° O. Ibáñez (University of Granada, Spain) 

e M.I Huete (University of Granada, Spain) 

* T. Kahana (Israel National Police, Israel) 

* C. Wilkinson (University of Dundee, UK) 

° E. Ferguson (University of Dundee, UK) 

° C. Erolin (University of Dundee, UK) 

e P.T. Jayaprakash (Universiti Sains Malaysia, Malaysia) 

° R. Jankauskas (Vilnius University, Lithuania) 

* F. Cavalli (Azienda Ospedaliero-Universitaria di Trieste, Italy) 

° K. Imaizumi (National Research Institute of Police Science, Japan) 

* R. Vicente (University of Coimbra, Portugal) 

* D. Navega (University of Coimbra, Portugal) 

° E. Cunha (University of Coimbra, Portugal) 

° A.H. Ross (North Carolina State University, USA) 

* E. Veselovskaya (Russian Academy of Sciences, Russia) 

* A. Abramov (Moscow Regional Bureau of Forensic Medicine, Russia) 
° P.Lestón (Guardia Civil, Spain) 

* F. Molinero (Guardia Civil, Spain) 

° E. Ruiz (Complutense University, Spain) 

e F. Navarro (University of Granada, Spain) 

° J. Cardoso (Policía Judiciaria, Portugal) 

° F. Viegas (Policía Judiciaria, Portugal) 

* D. Humpire (University Wiener-INML and Public Ministry, Peru) 

° R. Hardiman (University of Melbourne, Australia) 

* J. Clement (University of Melbourne, Australia) 

* A. Valsecchi (European Centre for Soft Computing, Spain) 

* B.R. Campomanes-Alvarez (European Centre for Soft Computing, Spain) 
* C. Campomanes-Alvarez (European Centre for Soft Computing, Spain) 
° A.S. Cagdir (Council of Forensic Medicine, Turkey) 
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° T. Briers (South African Police Service, South Africa) 

° M. Steyn (University of Pretoria, South Africa) 

° M. Viniero (Consorzio Ricerca Sistemi ad Agenti, Italy) 

° D.N. Vieira (European Council of Legal Medicine, Germany) 
° O. Cordón (University of Granada, Spain) 


In my role of MEPROCS coordinator, I’m also taking this opportunity to express 
my sincere gratitude to my good friend Dr. Oscar Ibáñez, who was my “right-hand 
man” since we made the decision to apply for the EU grant. This handbook together 
with most of the numerous MEPROCS tasks was successfully accomplished thanks 
to him and his passionate dedication to the project. 

Likewise, the contribution of the administrative staff of the European Centre for 
Soft Computing was really significant. In alphabetic order, my acknowledgments go 
to: 


° N. Bueno, Economist 

° J.R. Gonzalez, Accountant 

* C. Jiménez, Dissemination and Knowledge Manager 
° C. Peña, Project Manager 

* L.A. Roces, Secretary 

* MJ. Santano, Secretary 


Given the importance of this handbook for its authors, it is provided under an 
open-access license in order to facilitate its widest dissemination among all CFS 
practitioners, researchers, and stakeholders. 


Mieres Sergio Damas 
May 2015 


Project Overview 


The “New Methodologies and Protocols of Forensic Identification by Craniofacial 
Superimposition (MEPROCS)” project was a Coordination and Support Action 
granted by the European Commission that started in February 2011. In principle, 
the duration of the project was 24 months. However, an extension of 6 months was 
approved by the European authorities given the evolution of the tasks, the consid- 
erable number of participants that joined the project, and the expected outcomes. 

This handbook is the final result and more important deliverable of the 
MEPROCS project. According to the description of work, the particular objectives 
of the project are focused on supporting the development of a trustable craniofacial 
superimposition (CFS) methodological framework by fulfilling requirements cov- 
ering educational, technical, economic, social, and security aspects. According to 
the documents included in the Grant Agreement of the project, this would be 
achieved by: 


1. Definition of standard protocols for the application of CFS to different 
forensic scenarios: During its century and a half of development, the CFS 
forensic identification technique has been successfully applied to a huge number 
of case studies all around the world. The establishment of specific forensic 
protocols for the application of CFS to different scenarios (crime scenes, missing 
persons, mass disasters, mass graves, terrorism, etc.) is a real need. 

2. Specification of objective and semiautomatic validation techniques for CFS 
identification results: The defined protocols should depend on a reliable tech- 
nique. Clear and objective evidence evaluation criteria must be established to 
measure the quality of CFS outcomes, avoiding subjectivity and removing 
potential biases. 

3. Definition of the CFS-based forensic identification framework: The combi- 
nation of protocols and validation methods defined in the preceding two objec- 
tives and of the previously defined semiautomatic CFS system will result in an 
easy-to-use framework, which will speed up the correct identification of deceased 
people in the different forensic scenarios mentioned. 
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4. Dissemination and awareness raising: The MEPROCS project will focus 
specially on the dissemination of its results and on creating ample awareness in 
European stakeholders. 


MEPROCS Work Packages 


The workload of the MEPROCS project was detailed in the document “Description 
of work (DoW)” approved by the European Commission. It was split into a number 
of work packages shown in Fig. 1 and described as follows: 


WP1. Analysis of the Existing Methods and Procedures in the Field of CFS- 
Based Forensic Identification 
Review the state of the art in forensic identification from skeletal remains by CFS: 


Review forensic anthropology literature looking for applications of the CFS 
technique to identification cases. We will study the specialized scientific literature 
to identify all the reported applications of the CFS technique, including materials, 
methods, and tools used. 

Report internal procedures, protocols, and tools used to apply the CFS technique 
as well as previous implementations and experiences with the application of the 
CFS technique in different scenarios. 

Identify and create a list of users, researchers, and laboratories working on the 
CFS technique all over the world. 


WP2. Consolidation of the Network 
Engage new stakeholders and refine and focus the project agenda. 


Contact the most representative forensic anthropology labs and researchers to let 
them know about MEPROCS and try to incorporate them into the network. 
Correct possible deviations in the planned agenda and adapt the work plan after 
new stakeholders and/or new possible collaborations or interactions with other 
projects have been made. 


WP3. Standard Protocols Definition 
Establishment of specific protocols for the application of CFS to different scenarios: 


Identify and discuss the advantages and disadvantages of the different SC 
methods found in the literature. 
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Standard protocols definition 
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Fig. 1 Scheme of MEPROCS work packages and the relationships among them 


° Identify the different scenarios (including their description) where CFS has been 
applied, reporting common problems, the number of tackled and solved cases, as 
well as predominant scenarios and reliability. 

° Identify and discuss advantages and disadvantages of the different procedures 
and/or protocols followed by the end users in the network. 

° Define standard protocols for each kind of considered scenario: missing people, 
mass disasters, common graves, etc. 


WP4. Specification of Validation Techniques 
Identification of objective and automatic CFS validation techniques and validation 
of the proposed CFS method: 


* Review previous approaches related to manual or semiautomatic assessment of 
the CFS results. 

° Report and analyze the different validation approaches followed by the end users 
in the consortium. 

° Propose semiautomatic methods to assess CFS results. 

° Study ethical and legal issues concerning scientific use of identification cases. 
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* Compilation of solved and unsolved identification cases. 

* Preparation of the materials involved in the identification cases. 

* Objective assessment of the robustness and accuracy of the automatic CFS 
method. 


WPS. Global CFS Identification Framework Definition 
Design a set of protocols, techniques, and methods that can be easily distributed and 
accessed by stakeholders: 


* Define an easy-to-use automatic CFS framework. 

* Establish a validation procedure for the defined CFS framework to be followed by 
the end users. 

* CFS framework validation over different (simulated) scenarios. 


WP6. Project Coordination and Management 
Address the project management and coordination tasks and those related with 
ethical issues: 


* Address the project management and coordination tasks. 

* Coordinating stakeholder involvement and obtaining broad support from the 
users’ community. 

* An Ethical Issues Committee will be created to supervise the ethical issues that 
arise during its development. 


WPT7. Dissemination and Training 

Improve communication between the different communities involved, disseminate 
among the end users in the proposed automatic CFS framework, increase the 
visibility of the network, produce and publish a handbook on CFS, and organize 
public events to disseminate the network results: 


* General dissemination activities. 

* Create a distribution list, work groups, and a wikiportal. 

* Carry out a training workshop on the proposed automatic CFS framework. 

* Produce and publish a handbook on CFS. 

* Organize public event(s) to present the results of the network collected in a 
handbook. 


MEPROCS Consortium 


The MEPROCS consortium consists of partners, associated partners, supporting 
institutions, and committees of different countries. The countries with at least one 
institution involved in this initiative are represented in Fig. 2. We detail below the list 
of participants in the MEPROCS network: 


Partners 


European Centre for Soft Computing (ECSC), Spain 
Consorci di Recerca Sistemi ad Agenti (CORISA), Italy 
European Council of Legal Medicine (ECLM), Germany 


Fig. 2 Countries involved in the MEPROCS project 
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Universidad de Granada (UGR), Spain 

Ministry of Public Security-Israel National Police (INP), Israel 
Forensic Sciences Centre (FSC)-University of Coimbra, Portugal 
Ministry of Interior-Guardia Civil (GC), Spain 


Associated Partners 


Policía Judiciaria (PJ), Portugal 

Council of Forensic Medicine (CFM), Turkey 

Centre for Anatomy and Human Identification (CAHID), UK 
Laboratorio di Antropología e Odontología Forense (LABANOP), Italy 
Moscow Regional Bureau of Forensic Medicine (MRBFM), Russia 
Vilnius University (VU), Lithuania 

Universidad Complutense de Madrid (UCM), Spain 

Azienda Ospedaliero-Universitaria di Trieste, Italy 


Supporting Institutions 


Dr. Niels Morling (University of Copenhagen, Denmark) 

Dr. P.T. Jayaprakash (Universiti Sains Malaysia, Malaysia) 

Dr. J.G. Clement (University of Melbourne, Australia) 

Dr. D.J. Humpire (University Wiener-INML and Public Ministry, Peru) 

Dr. A. Ross (North Carolina State University, USA) 

Dr. M. Steyn (University of Pretoria, South Africa) 

Dr. K. Imaizumi (National Research Institute of Police Science, Japan) 

Dr. E. Veselovskaya (Institute of Ethnology and Anthropology of the Russian 
Academy of Sciences, Russia) 

Dr. S. K. Dhattarwal (University of Health Sciences, Rohtak, Haryana, India) 

Captain Teunis Briers (South African Police Service, South Africa) 


Committees 


Management Committee 


One member for each full and associated partner. Chaired by ECSC as project 
coordinator. 


Dr. Sergio Damas (European Centre for Soft Computing, ECSC) 
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Dr. Oscar Cordón (Dept. Computer Science and Artificial Intelligence) and 
Dr. Miguel Botella (Forensic Anthropology Laboratory-University of Granada, 
PAL) 

Dr. Vincenzo Loia (Consorzio Ricerca Sistemi ad Agenti, CORISA) 

Dr. Tzipi Kahana (Israel National Police, INP) 

Dr. Eugenia Cunha (Forensic Science Centre-University of Coimbra, FSC) 

Mr. Francisco Molinero (Ministry of the Interior-Guardia Civil, GC) 

Dr. Duarte Nuno Vieira (European Council of Legal Medicine, ECLM) 

Mr. Fernando Viegas (Policía Judiciária Portugal, PJ) 

Dr. Yalçin Büyük (Council of Forensic Medicine, CFM) 


Administrative Coordinator 


Dr. Carmen Peña (European Centre for Soft Computing) 


Dissemination Manager 


Ms. Carolina Jiménez (European Centre for Soft Computing) 


Ethical Committee 


Dr. Duarte Nuno Vieira (European Council of Legal Medicine, ECLM) 
Dr. Cristina Cattaneo (Laboratorio di Antropologia e Odontologia Forense) 
Dr. Douglas Ubelaker (The George Washington University) 

Dr. Margarida Silvestre (European Council of Legal Medicine) 


Security Committee 


Dr. Tzipi Kahana 

Mr. Francisco Molinero 
Dr. Miguel Botella 

Dr. Eugenia Cunha 
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Advisory Board 


Forensic Anthropology Society Europe (FASE) 

International Association of Forensic Sciences (IAFS) 

World Police Medical Officers (WPMO) 

Dr. P.T. Jayaprakash (Universiti Sains Malaysia) 

Dr. Niels Morling (Director of the Department of Forensic Medicine of the Univer- 
sity of Copenhagen) 

Dr. Cristina Cattaneo (Laboratory of Forensic Anthropology and Odontology, 
University of Milan) 


Meetings 


In order to coordinate the evolution of the different activities of the project, the 
MEPROCS consortium attended different meetings with specific agendas. They are 
briefly described as follows. 


Mieres, Spain: March 12-13, 2012 


The goal of this first meeting was to present the general aspects of the project such as 
aim, partners, objectives, calendar, budget, etc. 

All the full and associated partners, and the supporting institutions, made a short 
presentation about their expertise, research lines, and interests. 

A brief description was made about the Research Executive Agency (REA) and 
of all the legal documents concerning MEPROCS: Grant Agreement, Consortium 
Agreement, and Certificate on financial statements. Eligible costs and payment 
modalities were detailed, as well as report procedures, audits, and causes for grant 
suspension. 

The project management structure was also explained. 

MEPROC’s Committees composition was decided at this meeting. Then, a brief 
description of all the work packages, the tasks and deliverables involved in each of 
them, and the list of participants and leading institutions was introduced. Finally, the 
plan of next steps and an open discussion closed the event. 

The meeting attendees were the following: 


Dr. Sergio Damas (ECSC, Spain) 

Dr. Oscar Cordón (ECSC, Spain) 

Dr. Oscar Ibáñez (ECSC, Spain) 

Dr. Raúl del Coso (ECSC, Spain) 

Dr. Carmen Peña (ECSC, Spain) 

Dr. Miguel Botella (PAL, Spain) 

Dr. Inmaculada Aleman (OPAL, Spain) 

Dr. Vincenzo Loia (Director CORISA, Conzozio Ricerca Sistemi ad Agenti, Italy) 
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Dr. Mario Veniero (CORISA, Consorzio Ricerca Sistemi ad Agenti, Italy) 
Dr. Tzipi Kahana (Ministry of Public Security-INP, Israel) 
Dr. Eugenia Cunha (FSC-University of Coimbra, Portugal) 
Dr. Sonia Codinha (FSC-Universidad Coimbra, Portugal) 
Mr. Francisco Molinero (Ministry of the Interior-GC, Spain) 
Mr. Patricio Lestón (Ministry of the Interior-GC, Spain) 

Ms. Ascencáo Rebelo (ECLM, Portugal) 

Mr. Fernando Viegas (PL, Portugal) 

Dr. Yalçin Büyük (CFM, Turkey) 

Dr. A. Cadgir (CFM, Turkey) 

Dr. Niels Lynnerup (University of Copenhagen, Denmark) 
Dr. P.T. Jayaprakash (Universiti Sains Malaysia, Malaysia) 
Dr. Pasquale Poppa (LABANOF, Italy) 


Coimbra, Portugal: May 31, 2012 


The general aspects of the project such as aim, partners, objectives, calendar, and the 
budget were summarized in this meeting. The coordinator also informed about the 
application of two different institutions to become associated partners. Then, the 
management committee voted and approved their inclusion. The financial rules of 
the project were discussed and planned, as well as the work plan and the ethical 
issues about data protection. The project logo and website (www.meprocs.eu) were 
also presented (Fig. 3): 
The meeting attendees were: 


Dr. Sergio Damas (ECSC, Spain) 

Dr. Oscar Ibáñez (ECSC, Spain) 

Dr. Raúl del Coso (ECSC, Spain) 

Dr. Miguel Botella (PAL, Spain) 

Dr. Inmaculada Alemán (PAL, Spain) 

Dr. Vincenzo Loia (CORISA, Consorzio Ricerca Sistemi ad Agenti, Italy) 
Dr. Mario Veniero (CORISA, Consorzio Ricerca Sistemi ad Agenti, Italy) 
Dr. Tzipi Kahana (Ministry of Public Security-INP, Israel) 

Dr. Eugenia Cunha (FSC-University of Coimbra, Portugal) 

Dr. Sonia Codinha (FSC-Universidad Coimbra, Portugal) 

Mr. Ricardo Vicente (FSC-Universidad Coimbra, Portugal) 

Mr. David Navega (FSC-Universidad Coimbra, Portugal) 

Mr. Francisco Molinero (Ministry of Interior-GC, Spain) 

Mr. Patricio Lestón (Ministry of Interior-GC, Spain) 

Dr. Vieira Nuno Viera (ECLM, Portugal) 

Mr. Fernando Viegas (PL, Portugal) 

Ms. Angela Azinheira (PL, Portugal) 

Dr. Yalcin Büyük (CFM, Turkey) 

Dr. Danilo de Angelis (LABANOF, Italy) 
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Fig. 3 MEPROCS website (www.meprocs.eu) with the MEPROCS logo 


The Hague, Netherlands: August 22-23, 2012 


In this meeting, new associated partners were introduced. After a brief summary of 
the MEPROCS project, the deadlines established in the previous meeting were 
extended. Then, the work packages and the deliverables were discussed, task 
by task. 

The composition of the ethical committee was definitively approved, and all the 
partners started a discussion regarding ethical issues for sharing cases. The copyleft 
license to publish a final handbook was also proposed in this meeting. To facilitate 
the dissemination of the MEPROCS activities, this event took place together with the 
“6th European Academy of Forensic Science Conference" (EAFS 2012). 
MEPROCS was presented with its own booth (Fig. 4), and different oral presenta- 
tions were accepted in the EAFS 2012 Program. 

The participants were: 


Dr. Sergio Damas (ECSC, Spain) 

Dr. Oscar Ibáñez (ECSC, Spain) 

Dr. Raúl del Coso (ECSC, Spain) 

Dr. Mario Veniero (CORISA, Consorzio Ricerca Sistemi ad Agenti, Italy) 
Dr. Tzipi Kahana (Ministry of Public Security-INP, Israel) 

Dr. Sonia Codinha (FSC-University of Coimbra, Portugal) 

Mr. Francisco Molinero (Ministry of Interior-GC, Spain) 

Mr. Patricio Lestón (Ministry of Interior-GC, Spain) 

Dr. Duarte Nuno Vieira (ECLM, Portugal) 

Mr. Fernando Viegas (PL, Portugal) 

Dr. YalCin Büyük (CFM, Turkey) 

Dr. Caroline Wilkinson (University of Dundee, UK) 

Mr. Carlos Alberto Jiménez (Procuraduría General de la Repüblica, Mexico) 
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Fig. 4 MEPROCS booth at the EAFS 2012 Conference 


Madrid, Spain: February 3-5, 2013 


A detailed review of deliverables was presented in this event. All the partners had 
agreed on the need to do a first reliability study in order to determine which CFS 
methods performed better. Then, an open discussion about ethical issues related to 
the project took place. Finally, the partners accepted to publish in journals or 
conferences part of the results included in the handbook. 

Meeting attendees (Fig. 5): 


Dr. Sergio Damas (ECSC, Spain) 

Dr. Oscar Ibáñez (ECSC, Spain) 

Dr. Raúl del Coso (ECSC, Spain) 

Dr. Fernando Navarro (UGR, Spain) 

Ms. María Isabel Huete (UGR, Spain) 

Dr. Mario Veniero (CORISA, Italy) 

Dr. Tzipi Kahana (INP, Israel) 

Dr. Eugenia Cunha (FSC, Portugal) 

Mr. Francisco Molinero (GC, Spain) 

Mr. Patricio Lestón (GC, Spain) 

Dr. Duarte Nuno Vieira (ECLM, Portugal) 
Dr. Margarida Silvestre (ECLM, Portugal) 
Mr. Fernando Viegas (PJ, Portugal) 

Mr. Joao Paulo Cardoso (PJ, Portugal) 
Dr. Yalçin Büyük (CFM, Turkey) 

Dr. Caroline Wilkinson (CAHID, UK) 
Dr. Alexey Abramos (MRBFM, Russia) 
Dr. Rimantas Jankauskas (VU, Lithuania) 
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Fig. 5 Participants of the MEPROCS meeting in Madrid, Spain 


Dr. José Antonio Sanchez (UCM, Spain) 
Dr. Elena Ruíz Mediavilla (UCM, Spain) 


Granada, Spain, International Workshop: May 27-29, 2013 


Over 3 days, a workshop on CFS was held in Granada as part of the planned 
MEPROCS activities. 

Among the participants from the beneficiaries and associated partners, supporting 
institutions and the invited speakers attended the workshop. International experts in 
CFS were invited to the workshop in order to discuss about CFS achievements and 
new challenges, according to the MEPROCS project objectives. Three different 
work panels were defined for the 3 days: CFS methods, assessing CFS results, and 
CFS reliability. A round table was organized where different issues within each work 
panel were discussed. Experts came to a draft agreement on different CFS issues. In 
particular, the recommended landmarks for the CFS orientation process and the 
skull-face consistency evaluation, and concerning degrees of confidence and require- 
ments for each of them were discussed in the final identification decision. Docu- 
ments with these agreements were included in the first draft of the handbook. 

After the last activity of the workshop, a new meeting of the MEPROCS 
Management Committee took place. 

Meeting attendees (Fig. 6): 
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Fig.6 Attendees of the MEPROCS meeting in Granada, Spain 
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Jerusalem, Israel: October 2-3, 2013 


In this meeting, the participants confirmed the appropriate progress made in the 
project. This initial positive feedback was confirmed with three particular decisions: 


— A detailed and positive review of the project officer to allow the project to 
continue with minor modifications only. 

— A 6-month project extension to recover from the start-up delay and complete the 
tasks of WP4 andWPS5. 

— The inclusion of the MEPROCS Project in the new edition of the Security 
Research Catalogue 2013 as one of the leading projects. 


The meeting attendees were the following (Fig. 7): 
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Fig. 7 MEPROCS representatives during the meeting in Jerusalem 
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Salerno, Italy: March 3-7, 2014 


After the welcome by the mayor of Salerno and the rector’s representative at the 
University of Salerno (Fig. 8), the project coordinator briefly reviewed the work 
done so far and the remaining tasks and deliverables. The last news concerning the 
final conference, the current state of several upcoming publications, and financial 
issues were also summarized. 

Participants discussed about CFS technical aspects and analyzed in depth the CFS 
study performed. They also discussed about best practices in video superimposition. 
Finally, they analyzed the relationship between the face and the skull in order to 
propose some criteria to study the correspondence between them. 

A new website for the final conference registration was presented (https:// 
iccfs2014.wonference.com), shown in Fig. 9: 


Fig. 8 Presentation of the MEPROCS meeting by the coordinator and different authorities of 
Salerno 
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The meeting coincided with the "International Conference on Craniofacial Super- 
imposition," which was the final MEPROCS event (Fig. 10). The main conclusions 
of the project were presented to all the delegates who also had the chance to 
experience different approaches to CFS by various international labs (Spain, 
Japan, UK, Malaysia, and Lithuania) More than 100 delegates attended the 
conference. 


Fig. 10. Welcome to the delegates of the MEPROCS International Conference on CFS (ICCFS 
2014) 
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During the meeting, the coordinator informed the MEPROCS participants about 
the final review of the project by European authorities. According to the instructions 
of the project officer, he congratulated all the members of the MEPROCS consor- 
tium for their excellent contribution to the project success. The participants also 
analyzed the state of the pending tasks, mainly related to the dissemination of results. 
Finally, they discussed the potential use of data after the project and possible 
collaboration and common initiatives for the future. 
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Chapter 1 A 
Introduction to Craniofacial iin 
Superimposition 


The main focus of forensic anthropology lies in the determination of the identity of 
human remains when skeletal information becomes the last resort for forensic 
assessment (Burns 2007; Yoshino and Seta 2000; Alemán et al. 1997). In the last 
few decades, anthropologists have focused their attention on improving the tech- 
niques that help us in make the most accurate identification. 

Before making an identification decision, anthropologists follow different pro- 
cesses to assign ancestry, sex, age, and height to human remains from the study of 
ante-mortem information (which can be retraced from visual material and interviews 
with relatives or witnesses) and post-mortem data (the skeletal remains found, i.e., 
bones). Different methodologies have been proposed for this purpose, with each 
implemented according to the features of the population group from which the 
method was derived (Alemán et al. 1997; Iscan 2005; Gonzalez-Colmenares et al. 
2007; Urquiza et al. 2005; Landa et al. 2009). As these methods are population 
specific, they require the pre-determination of ancestry. The aforementioned anthro- 
pological studies are usually taken as the first step in the identification process, prior 
to the application of any other technique, as the determination of the main biological 
parameters (sex, age, stature, build, teeth, possible pathologies, etc.) reduces the 
number of individuals for comparison. Nevertheless, there are several other identi- 
fication procedures that are more reliable than skeleton-based identification and can 
be applied either with the forensic anthropology evaluation or without it, such as 
(Stratmann 1998): 


1. Comparison of fingerprints and foot and hand prints. 

2. Comparison of data from the jaw and teeth (dental information). 

3. External and internal autopsy. In the former, the location, size, and significance of 
scars, moles, tattoos, and even callous spots on the hands and feet are compared, 
whereas the internal autopsy looks for correspondence with regard to diseases and 
operations of the “disappeared person,” which are retraceable in the recovered 
body, e.g., hysterectomy or prosthetic joint replacements. 
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4. Deoxyribonucleic acid (DNA) research demonstrating a blood relation with 
known family members. 


The application of these methods can be problematic, as on some occasions there 
is not enough information (ante- or post-mortem) available in order to conduct them. 
With regard to post-mortem data, the state of preservation of a corpse can vary 
considerably as a result of several chemical and mechanical factors. While the 
skeleton usually survives both natural and non-natural decomposition processes 
(fire, salt, water, etc.), the soft tissues (skin, muscles, hair, etc.) progressively 
degrade and are lost. The main disadvantage of DNA testing is the relatively large 
amount of high-quality tissue material required, which is not common in remains 
that were buried a long time ago. On the other hand, with regard to ante-mortem 
information, the first method requires the existence of a print database, the second is 
dependent on the availability of dental records (although in comparison to bones and 
skin, the teeth are more resistant to the effects of fire and salt water), the third 
requires previous X-ray images (among other information), and the last method 
depends upon a second DNA sample, either from the same person or from a relative. 

Hence, anthropological identification based only on skeletal information can be 
considered as a final option for forensic identification when none of the previous 
methods can be applied. If the soft tissue or DNA methods cannot be applied but the 
skeletal studies provide positive results, then more specific skeleton-based identifi- 
cation techniques can alternatively be applied. These can include craniofacial super- 
imposition (CFS) (İşcan 1993; Rathbun 1984; Taylor and Brown 1998). 

Craniofacial superimposition is a forensic process in which photographs or still 
frame images taken from video recordings of a missing person are compared with the 
skull that is found. By projecting both photographs on top of each other (or, even 
better, matching a scanned three-dimensional skull model against the face photo/ 
series of video shots), the forensic anthropologist can try to establish whether they 
belong to the same person (Krogman and İşcan 1986) based on the similarity of 
morphological features common to both. 

Therefore, in every system, for skull identification by craniofacial superimposi- 
tion, two objects are involved: a skull and an image of a face. The latter is typically a 
photograph although it can be sometimes replaced by a series of video shots or, more 
rarely, a portrait of the missing person. The final goal, common to every system, is to 
assess the anatomical consistency between the skull and the face. 

Before reviewing the literature of this forensic identification technique, one 
should note that different terms have been used to refer to CFS over more than a 
century of its development. This has been mainly due to the use of close synonyms 
and also because of the coining of new, more specific terms depending on the 
supporting technical devices used throughout the developmental history of the 
overall technique. The following points justify our choice of “craniofacial superim- 
position” as the most general and currently appropriate name for this forensic 
identification method. 
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— Craniofacial superimposition is the term widely found in the literature, which 
refers to all the tasks related to this forensic identification technique (Ubelaker 
et al. 1992; Yoshino et al. 1995; Cattaneo 2007). In particular, the most recent 
studies confirm the suitability of this terminology (Ranson 2009; Ibáñez et al. 
2009a, 2011; Pickering and Bachman 2012; Stephan 2009). 

— The term arises as a means to differentiate between the forensic technique itself 
and the technical devices used to tackle the identification problem. Indeed, 
craniofacial superimpositions were initially conducted using tracings made 
from photographs (Sen 1962; Webster 1955) and authors referred to the proce- 
dure as “photographic superimposition” (Dorion 1983; Brocklebank and 
Holməren 1989; Maat 1989). 


As a result of the rapid developments in video technology, the term “video 
superimposition” was then used when this tool became common in forensic identi- 
fication (Seta and Yoshino 1993; Pesce Delfino et al. 1993; Shahrom et al. 1996; 
Yoshino et al. 1997). Finally, the use of computers to assist anthropologists in the 
identification process has evolved the next generation of CFS systems.’ The latter 
approach is usually referred to as “computer-aided” or “computer-assisted CFS”? 
(Pesce Delfino et al. 1986; Ubelaker et al. 1992; Aulsebrook et al. 1995; Yoshino 
et al. 1997). 

Hence, when using the generic term CFS, we are assuming neither a particular 
acquisition device nor a given data format for the input of our problem. We simply 
consider that any CFS method will deal with a 2D image of the disappeared person 
(typically a photograph) and corresponding images derived from the 3D skull 
recovered (possibly alongside other skeletal remains). 

We are aware there are some authors who prefer to use the term “photographic 
supra-projection” (Bronkhorst 2006; Stratmann 1998). We avoid its use because it 
does not explicitly indicate the matching of a skull with a face. 

Finally, CFS should not be confused with craniofacial identification either. 
It is important to recognize that the latter is used as an umbrella term, which includes 
both CFS and the very different technique of facial approximation" (Clement 


! Attempts to achieve high identification accuracy through the utilization of advanced computer 
technology have been a monumental task for experts in the field in the last two decades (Lan1992). 
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Notice that the terms “skull-face superimposition,” “skull-photo superimposition,” “photographic 
superimposition,” and “video superimposition” have also been used in combination with the 
“computer-aided/assisted” adjective. 

3In the past, facial approximation methods have been known by many other names. The most 
popular of these is facial reconstruction. This name is highly misleading as it creates the erroneous 
impression that the methods are exact, reliable, and scientific. STEPHAN, C. N. 2009. Craniofacial 
identification: techniques of facial approximation and craniofacial superimposition. In: BLAU, 
S. and UBELAKER, D. H. (eds.) Handbook of Forensic Anthropogy and Archeaology. Walnut 
Creek, CA, USA: Left Coast Press. 
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and Ranson 1998; Wilkinson 2009; Stephan 2009). Both methods are underpinned 
by the knowledge of human craniofacial anatomy. It is this principle that ties these 
two techniques together despite the use of different technical protocols for each 
of them. 
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Chapter 2 A) 
Importance of Craniofacial ss 
Superimposition in Forensic Identification: 
Historical Perspective 


The successful comparison of human skeletal remains with artistic or photographic 
replicas has been achieved many times using CFS. From the identification of well- 
known criminals, such as Adolf Hitler’s chief medical officer Dr. Josef Mengele 
(Teixeira 1985; Helmer 1987), to the identification of victims of the recent Indian 
Ocean tsunami (Al-Amad et al. 2006) and in the identification of terrorists (Indriati 
2009), this technique has been under continued development since its first applica- 
tion in 1935 (Glaister and Brash 1937). Craniofacial superimposition has become 
increasingly relevant in forensic scenarios worldwide. 

Case studies are ideal for providing information regarding the evolution of the 
CSF technique and its application in various forensic situations. The most relevant 
identification works based on CFS throughout history are reviewed below. 

The first documented cases, in which ante-mortem images were compared to 
cranial remains, date to the early twentieth century. In these instances, CFS served as 
supporting evidence to be presented in court rather than the principal means of 
identification of the victim. 

Perhaps the most prominent case of this early period is the Ruxton case in 1937, 
in which two female skulls were compared to photographs of missing women using 
the superimposition technique (Glaister and Brash 1937). The comparison served as 
supporting evidence in the identification of the two skulls. However, the CFS 
evidence was not accepted by the court as a means for confirming a positive 
identification. 

After Ruxton, the second case recorded in the literature is the Baptist Church 
Cellar Murder. In this case, the Photography Department of Guy’s Hospital in 
London was able to superimpose a full-face portrait of a woman onto a full-face 
X-ray of a skull. The resulting superimposition contributed to the identification of 
the woman (Simpson 1943). 

Three years later, Gordon conducted the identification of a severely burnt body 
found in an incinerated car near Durban, South Africa. Once again, based on the 
methodology followed in the Ruxton case, the investigators obtained three photo- 
graphs of the suspected victim in order to make a comparison with the skull. The 
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photographs were used to draw an outline of the head of the victim, which was 
superimposed onto a machine-made projection drawing of the skull in approxi- 
mately the same orientation as the head in the photograph. Based on good anatom- 
ical correspondence, the investigators established the identification with a 
considerable degree of probability (Gordon and Drennan 1948). 

Other cases in which photographic superimposition was accepted as part of the 
evidence for identification have been reported in South Africa, (Prinsloo 1953) and 
Sri Lanka. The latter case, known as the Plumbago Pit case in 1947, aroused public 
interest, when a putrefied body was found floating in a pit. One and a half months 
later, without solid evidence as to the identity of the body, Professor G. S. W. Saram 
explored the possibility of applying the CFS technique. Once again, the methodol- 
ogy was based on the Ruxton case. Neither the identity of the body nor the accuracy 
of the technique employed was questioned during the trial (Webster 1955). 

Although the CFS technique has proved to be helpful in the identification process, 
the first positive identification accepted in court, based solely on CFS, took place in 
1962 in acase reported by Sen (1962). Sen’s paper does not offer many details on the 
methodology implemented, but it does mention that the investigators performed 
control experiments on collections from the Anatomy Department of the Calcutta 
Medical College to validate their findings. The Supreme Court of India accepted the 
comparison of the photo and the skull as evidence for a positive identification 
(Ubelaker et al. 1992). 

In 1973, a prominent case was reported in India. Dismembered parts of a human 
body, including a human skull, were found over a period of 5 days and an analysis 
was conducted in order to obtain a positive identification. Captain K. Nagaraju, a 
doctor in the Indian army, was suspected of murdering his wife and child on a train 
during their journey from Delhi to Secunderabad. In a hotel bathroom in Secunder- 
abad, he dismembered his wife’s body into portions convenient for transport and 
dumped them at various places in a nearby tank to cover up the crime. The skull was 
identified by superimposing its photograph over a negative of an ante-mortem 
photograph of the suspected victim using the negative placed under the ground 
glass of the camera and marking the salient features of the face on the glass. The 
skull was mounted on an appropriate skull rest, placed in front of the camera and 
positioned so as to align it as accurately as possible with the outlines on the ground 
glass, making due allowance for the soft tissues covering the bone. In this position, a 
negative of the skull was prepared. The negatives of the photograph and the skull 
were superimposed by aligning the characteristic points in the negatives. In the 
report, the following cranial and facial landmarks were noted: (1) the eyes within the 
orbital plates, with the two pairs of canthii properly aligned; (2) the nasion; (3) the 
prosthion in the central line; (4) the nasal spine in the centre, which is a little above 
the tip of the nose; (5) the lower border of the nose; (6) the lower border of the upper 
jaw, that is, below the tip of the nose; and (7) the zygomas below the eyes. This case 
resulted in a positive identification and with the suicide of Doctor Nagaraju (Reddy 
1973). 

One of the most famous identification cases resolved by the use of CFS is that of 
Dr. Josef Mengele in Sao Paulo, Brazil, in 1985, the infamous physician of the 
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concentration camp in Auschwitz. Following a request made by the Brazilian 
authorities, a team of Brazilian, German, and American Scientists exhumed the 
remains of a cadaver suspected to belong to Dr. Josef Mengele, based on the 
information that he died in Brazil on February 7, 1979, and was buried in the 
cemetery of Embu/Sáo Paulo. Comparative data for the identification of the skeleton 
was recovered from a medical examination sheet from the SS main office for Race 
and Settlement in 1938. Data collected included date of birth, height, weight, cranial 
circumference, cranial form, type of body structure, two photographs of Dr. Josef 
Mengele in frontal and lateral views at the age of 27 and three at the age of 60. The 
authors concluded, based on various techniques, including CFS, that “there is no 
room for doubt that the exhumed skeletal parts are the remains of the corpse of 
Doctor Joseph Mengele” (Helmer 1987). 

Some years later, the presumed skull of W. A. Mozart was examined by a team of 
French scientists (Puech et al. 1989). The skull was measured exhaustively and it 
was found to have a very distinctive form (vertical forehead, reduced orbits, and 
alveolar prognathism). The cranium was superimposed onto wax portraits of Mozart, 
available from 1778 (The André Meyer collection) and from 1788 by L. Posch. The 
superimpositions showed good correspondence in the forehead contour, nasal pro- 
file, orbit shape, and cheek position. An analysis of the investigation indicated that 
there was complete conformity concerning all side proportions of the head. This 
“positive match” put an end to the stories about the remains of Mozart being lost 
among the mixed bones of St. Marx’s cemetery in Vienna (Helmer et al. 1989). 

The first 50 years of development of the CFS technique is defined largely by case 
reports (Sen 1962; Reddy 1973; McKenna et al. 1984; Bastiaan et al. 1986; Basauri 
1967; Vogel 1968; Sekharan 1971; Gejvall 1974; Sivaram and Wadhera 1975; 
Janssens et al. 1978; Brown 1982; Webster et al. 1986). These identification cases, 
solved using only photographs of both the skull and the face, belong to the first 
generation of CFS methods called photographic CFS. In the ensuing years, a new 
modality of CFS techniques based on video technology made their way into the 
scientific realm. Helmer and Griiner (1977a, b) were the first researchers to introduce 
the video superimposition technique. They took advantage of the “live images” of 
the object (skull and photograph) instead of taking photographs, or making tracings 
or drawings of the skull and face to superimpose them. These systems present an 
enormous advantage over the former photographic superimposition technique 
(Helmer and Griiner 1977a; Shahrom et al. 1996; McKenna et al. 1984; Austin- 
Smith and Maples 1994; Yoshino et al. 1995; Solla and Iscan 2001; Fenton et al. 
2008) and video superimposition is probably the most broadly employed method in 
terms of the number of cases solved to date. 

One of the first reports in the literature, regarding the use of CFS in a mass 
casualty incident, belongs to the video CFS modality. In February 2003, 
commingled human bones were recovered from the Sonora desert in Arizona. 
Among the numerous human postcranial skeletal elements, five skulls were found 
(three females and two males). The presumed identity of the victims was known; 
thus, the incident was considered a closed disaster. The two male victims and the 
youngest of the three female victims were identified through the analysis of their 
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biological profiles, conducted by a forensic anthropologist. The biological profiles of 
the final two females were very similar, requiring the use of other identification 
methods to discriminate between them. During the investigation, a photograph of 
one of the females was found and used to apply the CFS technique by a team of 
investigators from the Michigan State University Forensic Anthropology Labora- 
tory. The use of the following equipment was reported for the implementation of the 
technique: two video cameras, a video mixer, a TV monitor, a video cassette 
recorder, and a desktop computer with image-capturing software. Through this 
analysis, the investigating team was able to exclude one skull and include the 
other skull as a possible match. During an in-depth analysis of the technique, the 
authors concluded that CFS should only be used to exclude or fail to exclude an 
individual as a potential match, rather than to explicitly identify cadaveric remains 
(Fenton et al. 2008). 

Despite the high number of cases positively identified using video superimposi- 
tion techniques, the popularization, dramatic development, and endless possibilities 
offered by computers have turned them into the next-generation CFS systems. 

The first documented case of a superimposition performed using a “computer- 
enhanced” method was developed by a team of experts from the FBI, led by Prof. 
Ubelaker, in 1992. In 1991, a cranium and a mandible discovered in 1978 by a 
hunter in Putnam County, Ohio, were forwarded to the FBI alongside a facial 
photograph of the presumed victim. The investigators compared the photograph of 
the presumed victim and the articulated cranium and mandible with the help of a 
personal computer and proclaimed this approach “a new, rapid and highly effective 
method to demonstrate consistency between skeletal features of the head and facial 
photographs” (Ubelaker et al. 1992). Another well-known computer-assisted CFS 
case involved the identification of Dr. Eugénio Antonio Berrios Sagredo, the phy- 
sician accused of making nerve gas during the dictatorial regime of former Chilean 
President General Augusto Pinochet and whose remains were found in Uruguay in 
1995 (Solla and Iscan 2001). 

A variety of software packages are used to perform CFS, the most common one is 
Adobe Photoshop™. Bilge et al. (2003) described their use of this software together 
with Corel Draw™ in order to identify a decapitated body found in a suburban area 
of Ankara (Turkey). Cadaveric remains were found buried nearby an area where a 
skull exhibiting two gunshot wounds was found. In order to determine if the skull 
could be associated to the decapitated body, which had been identified by the wife of 
the deceased, the authors superimposed a photograph of the victim onto the 
disassociated skull and reported an "excellent adaptation." The positive match 
achieved by CFS was confirmed by a DNA analysis performed on the bones, dental 
pulp, and muscle tissue of the victim (Bilge et al. 2003). 

As expected, CFS systems based on the use of computers have become consis- 
tently more popular among practitioners. The final example of the use of such a 
system was recently reported by Pushparani et al. (2012). In this case, an approxi- 
mately 25-year-old male skeleton was found with a photograph next to it. The photo 
and the cranium were examined by the Anthropology Division of the Forensic 
Sciences Department in India. They employed computer-aided video 
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superimposition to perform a match between the photo and the cranium, concluding 
a likely identification. This was later confirmed by the radiographic comparison of a 
surgical plate found on the femur of the skeleton and the corresponding ante-mortem 
plate collected by the authorities (Pushparani et al. 2012). 

Furthermore, in the last 5-10 years, the superimposition technique has been 
greatly simplified by automating the overlay process through computer-aided 
methods (Nickerson et al. 1991; Ghosh and Sinha 2001; Ibáñez et al. 2009a). 
These are proposed to be the next-generation CFS systems. However, their use in 
identification cases is still very limited. Only one case has been reported in the 
literature that makes use of the Ghosh and Sinha (2001) CFS identification system 
(Ghosh and Sinha 2005). In this instance, an unidentified skeleton was found in a 
bush. The remains were photographed in situ and then collected by the authorities. 
As the body was never claimed, following the post-mortem examination, the skel- 
eton was cremated as is customary in India. A month later, the police found new 
evidence in the identification of the remains, but as they were no longer available, the 
investigators employed a novel CFS technique involving the preprocessing of the 
images from the scene for subsequent analysis by using artificial intelligence tech- 
niques. The proposed algorithm compared frontal views of the cranial and facial 
images and analyzed their hidden symmetry. During this process, the robust system 
suitably takes care of any ambiguities caused by soft tissue thickness in facial feature 
selection. The authors successfully superimposed one of the photos taken by the 
authorities onto one of the ante-mortem photographs of the deceased individual, 
achieving a positive match between the two pictures (Ghosh and Sinha 2005). 

This last case is, most probably, the forerunner of the next-generation CFS 
techniques. As the steps for achieving the superimposition itself are simplified by 
the use of computer techniques, this forensic method of identification will gain more 
acceptance among the scientific community. 
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Chapter 3 N) 
Relationships Between the Skull iiim 
and the Face for Forensic Craniofacial 
Superimposition 


3.1 Introduction 


The evaluation of any superimposition is a significant issue that is dependent on the 
consistency of the anatomical link between the location of the soft tissue surfaces 
relative to the underlying bone (Taylor and Brown 1998). 

In order to evaluate this consistency, a full comprehension of the anatomy of the 
skull and the relationship between the skull and the face are required. In biological 
organisms, structure and function are closely related. The human head, in terms of 
function, is related to four of the five senses: stereoscopic vision (eyes), audition 
(ears), gustation (tongue/mouth), and olfaction (nose), along with the protection of 
the brain. These functions are responsible for the structure of the head, and therefore 
the form of the face and the skull will be directly related to the position of the brain, 
eyes, ears, mouth, and nose. 

From an anthropological perspective, the reliability of CFS and an identification 
based on this technique are evaluated mainly on the basis of the consistency between 
the anatomical structures of the face and skull. 

The forensic expert usually relies on the analysis of anatomical criteria such as the 
soft tissue thickness, outlines, and positional relationships between the skull and the 
face. In the scientific literature, there are several studies conducted to assess the 
quality/degree of matching in CFS as well as to examine the criteria used to conduct 
this assessment. Before reviewing the different studies, Martin and Saller's studies 
(1957) must be considered. They created a treatise in which the fundamental pillars 
of this discipline were established. They defined an important set of craniometric and 
somatometric points (Tables 3.1, 3.2, and 3.3) that are crucial for all anthropological 
studies (Figs. 3.1, 3.2, 3.3, 3.4, 3.5, and 3.6). 

A correct evaluation of anatomical consistency between facial and cranial struc- 
tures is of paramount importance for reliable CFS. Generating accurate data on soft 
tissue thickness and the positioning of facial structures are important steps to 
improve current practices in craniofacial identification. At the moment, there is a 
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Table 3.1 Craniometric points from Martin (1914) study (neurocranium) 


Craniometric points: neurocranium 


ast asterion ft frontotemporale ms mastoideale 

au auriculare g glabella o opisthion 

b bregma i inion op opisthocranion 
ba basion 1 lambda po porion 

eu euryon m metopion so supraorbitale 


Taken from Martin and Saller (1957) 


Table 3.2 Craniometric points from Martin (1914) study (splanchnocranium) 


Craniometric points: splanchnocranium 


nasion rhinion 
gnathion nasospinale zygoorbitale 
go gonion or orbitale zm zygomaxillare 
ml mentale pg pogonion zy zygion 
mf maxillo-frontale pr prosthion 
Taken from Knufimann (1988) 
Table 3.3 Somatometric points from Martin (1914) study 
al |alare g glabellare ma | mastoidale pr | prosthion 
cdl | condylion go gonion n nasion prn | pronasale 
laterale 
ch | cheilion I inion or | orbitale ps | palpebrale 
superius 
en | endocanthion labm | labiomentale os |orbitale sa |superaulare 
superius 
eu |euryon li labrale inferius | pg | pogonion sba | subaurale 
ex | exocanthion ls labrale pi | palpebral Sci | superciliare 
superius inferius 

ft  |frontotemporale | m metopion po | porion se | sellion 

gn | gnathion op opisthocranion | pu | pupilare sn | subnasale 
sto | stomion t tragion tr | trichion v vertex 

zy |zygion 


Taken from Knußmann (1988) 


clear lack of consensus in methodological approaches for CFS. The development of 
standard protocols is necessary to enhance the credibility of the technique, making it 
more readily admissible in judicial processes. 


3.2 Anthropometrical Relationships 


Understanding the relationship between the skull and the facial soft tissue has major 
relevance for forensic identification. Facial soft tissue thickness, measured as the 
distance from the skin surface to the most superficial surface of the underlying 
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Fig. 3.1 Craniometric points in lateral view. Taken from Knufmann (1988) 


Fig. 3.2 Craniometric point in vertical view (left) and in occipital view (right). Taken from 
Knufmann (1988) 
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Fig. 3.3 Craniometric points in basilar view. Taken from Knufmann (1988) 


skeletal tissue at specific landmarks, provides an important criterion for the evalu- 
ation of anatomical consistency. This kind of measurement provides general infor- 
mation on the match between the face and the skull, using facial soft tissue thickness 
as a means to control the outer contour of the face during the superimposition 
(Codinha and Fialho 2010; Stephan and Simpson 2008). 

Due to the scientific value of facial soft tissue thickness in craniofacial identifi- 
cation, numerous studies have been conducted since 1883, with a great variation in 
measuring techniques, sample size, population ancestry, anatomical landmarks, and 
variables analyzed (e.g., sex, age, and body composition) (Codinha and Fialho 2010; 
Stephan and Simpson 2008). 
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Fig. 3.4 Craniometric points in frontal view. Taken from Knufmamn (1988) 


Some of the main modalities for soft tissue thickness acquisition mentioned in the 
literature include: 


* Needle puncture (Codinha and Fialho 2010; Simpson and Henneberg 2002; 
Domaracki and Stephan 2006; Rhine and Campbell 1980; Suzuki 1948; Birkner 
1905; Stadtmuller 1925; Rhine et al. 1982; Galdames et al. 2008; His 1895; von 
Eggeling 1909) 
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Fig. 3.5 Somatometric points in frontal view 


e Cephaloradiography (George 1987; Leopold 1968; Weinig 1958; Bankowski 
1958) 

* Ultrasound imaging (Aulsebrook et al. 1996; Wilkinson 2002) 

* Computer-assisted tomography (CT) (Phillips and Smuts 1996) 

* Cone-beam CT (Bankowski 1958) 

* Magnetic resonance imaging (Sahni 2002) 


A summary of the most important soft tissue thickness studies and their main 
characteristics are listed in Table 3.4. None of these methodologies offer a perfect 
solution, as each technique has advantages and disadvantages. For example, needle 
puncture methods are inexpensive, but cadaveric material is not wholly 
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Fig. 3.6 Somatometric points in lateral view 


representative of living subjects; CT scans are accurate and reproducible but may 
present gravity effects on the supine face, artifacts, and radiation damage; 
craniographs are inexpensive and the subject is upright, but the images can suffer 
from magnification and planar issues; ultrasound can be used on upright living 
subjects but involves contact and pressure issues. A more extensive list of advan- 
tages and disadvantages of the different methodologies used in soft tissue data 
collection was analyzed in Stephan and Simpson (2008) and in Preedy (2012). 
The latter is summarized in Tables 3.5 and 3.6. 

The soft tissue thickness depth measurements are applied in facial depiction, but 
if they are used in CFS, changes due to facial expression must also be considered 
when determining identity. These measurements are usually, but not always, per- 
pendicular to the bony structures, and are most useful if the image shows the soft 
tissue directly to the point of measurement (Clement and Ranson 1998). 
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Table 3.4 Landmarks used by authors, sample, and methodology 


Number 
Reference Date | of points | Male | Female | Total | Population? Methods 
Welcker 1883 7 13 13 | White Tissue punc- 
(Cadavers) ture by using 
needle 
His 1895 15 24 4 28 White Tissue punc- 
(Cadavers) ture by using 
needle 
Kollmann 1898 18 21 4 25 | White European | Tissue punc- 
and Buchly (Cadavers) ture by using 
needle 
Fischer 1905 18 2 2 |Mongoloid Tissue punc- 
(Papuans) ture by using 
needle 
Birkner 1905 18 9 6 |Mongoloid Tissue punc- 
(Chinese) ture by using 
needle 
Czekanowski | 1907 6 64 51 112 | White Cauca- Tissue punc- 
sian (Cadavers) | ture by using 
needle 
Von 1909 18 3 3 | Black Tissue punc- 
Eggeling (Hererons) ture by using 
needle 
Stadtmuller 1923- | 20 15 3 18 | Mongoloid, Tissue punc- 
1925 White ture by using 
needle 
Suzuki 1948 18 7 48 55 Mongoloid Tissue punc- 
(Japanese) ture by using 
needle 
Weinig 1958 10 99 21 120 | White Ameri- Craniographs 
cans (Living) 
Bankowski 1958 13 15 9 24 |White Craniographs 
Europeans 
(Living) 
Berger 1965 14 26 102 128 | White Cauca- Tissue punc- 
sian (Cadavers) | ture by using 
needle 
Leopold 1968 13 102 52 154 | White Craniographs 
Europeans 
(Cadavers) 
Sutton 1969 104 | White Cauca- Tissue punc- 
sian (Cadavers) | ture by using 
needle 
Rhine and 1980 21 44 15 59 American Black | Needle and 
Campbell (Unembalmed rubber-stopper 
cadavers) technique 
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Number 
Reference Date of points | Male | Female | Total | Population” Methods 
Farkas 1981 132 White (Cauca- 
sian North 
American 
population) 
Rhine et al. 1982 21 37 19 56 | American White | Tissue punc- 
Caucasian ture by using 
(Unembalmed needle 
cadavers) 
Rhine 1983 21 9 2 11 South-western Tissue punc- 
Indians ture by using 
(Cadavers) needle 
Helmer 1984 34 61 62 123 White European | Ultrasound 
(Living) 
Hodson et al. | 1985 20 50 | American Ultrasound 
Caucasians 
Dumont 1986 9 93 101 194 | Caucasian X-Ray 
George 1987 10 17 37 54 | Whites Ameri- | Lateral 
can (Living) craniographs 
Nanda and 1990 4 17 23 40 Caucasian X-Ray 
Meng 
Aulsebrook 1996 _ 55 55 Zulu (Living) Lateral, 
et al. Negroids oblique cepha- 
lometry 
ultrasound 
Phillips and 1996 21 16 16 32 | Mixed raced Computerized 
Smuts South Africans | tomography 
(Living) 
Manhein and | 2000 19 712 | American Ultrasound 
Listi 
El- 2001 17 120 84 204 | Egyptian Ultrasound 
Mehallawi (Living) 
and Soliman 
El- 2001 17 120 84 204 Egyptian Ultrasound 
Mehallawi 
and Soliman 
Sahni 2002 19 30 30 60  |Indians (Living) | MRI scans 
Simpson and | 2002 20 17 23 40 | Australian Tissue punc- 
Henneberg ture by using 
needle 
Wilkinson 2002 21 99 101 200 |British Ultrasonic 
Juveniles echo-location 
Williamson 2002 15 77 147 224 African X-Ray 
and American 
Nawrocki 
Utsuno and 2005 12 0 112 112 Japanese X-Ray 
Kageyama 
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Table 3.4 (continued) 


Number 
Reference Date | of points | Male | Female | Total | Population? Methods 
De Greef 2006 52 510 | 457 967 | White Cauca- Ultrasound 
et al. sian (Living) 
Domaracki 2006 13 19 14 33 | Australian Tissue punc- 
and Stephan ture by using 
needle 
Vander 2007 _ 5 5 10 American (mul- | MRI 
Pluym et al. tiple ancestries) 
Panenkova 2007 14 80 80 160 Slovak CT Scan 
Galdames 2008 14 30 30  |Cadavers Tissue punc- 
et al. ture by using 
needle 
Sahni et al. 2008 29 173 |127 300  |Indian MRI 
Inada et al. 2009 40 40 80 | Mongoloid Cephalograms 
(Japanese) 
(Living) 
Codinha and | 2010 20 103 48 151 Portuguese Tissue punc- 
Fialho ture by using 
needle 
Menezes 2009 50 531 | 357 888 Electronic 
et al. digitizer 
Tedeschi- 2009 11 26 14 40 | Brazilian Tissue punc- 
Oliveira et al. ture by using 
needle 
Cavanagh 2011 28 0 | 154 154 South African CT Scan 
and Steyn 
Saxena et al. | 2012 7 19 21 40 Indian CT Scan 
Hwang etal. | 2012 31 50 50 100 | Korean CT Scan 


“Population as described by the authors 


Other factors that must be taken into account when utilizing soft tissue data are 
growth, weight change, and age-related changes. For this purpose, many authors 
place emphasis on facial features with minimal soft tissue depth. The middle third of 
the face (eyes, nose, and teeth) is less influenced by any photographic distortion and 
could be considered more accurate (Taylor and Brown 1998). 

Currently, there is no agreement among practitioners as to the number of land- 
marks, their name, or their correct position; thus, comparison between the results of 
several papers is extremely difficult (Panenková 2007). Furthermore, some papers 
use the vernacular rather than anatomical terminology, that is, “end of nasal” 
(Phillips and Smuts 1996), “middle of the bony nose” (Helmer 1984), and “angle 
of mouth” (Aulsebrook et al. 1996; Panenkova 2007). 

There seems to be one major difference of opinion with regard to the thicknesses 
of facial tissues (Wilkinson 2002). The results obtained by the needle puncture 
method in cadavers are relative to the process of dehydration of the soft tissue 
(10-18 g/day/weight), resulting in considerable variations depending on the 
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Table 3.5 Comparison of the commonly used measuring techniques for calculating soft-tissue 


depth 

Method of 

measurement Advantage Disadvantage 
Needle puncture Low cost. Invasive. 


Operating characteristics well 
defined. Measurements can be made 
in Frankfort. Horizontal plane. 


Most information from cadavers, 
soft tissue may not accurately 
reflect living tissue. 

Compression of soft tissue inevita- 
ble during measurement. 

No visualization of the skeletal 
surface. 


Plain film Standard cephalograms widely used | Exposure to ionizing radiation, 
radiography in dentistry and medicine. patient selection may bias results. 
Films generally taken in Frankfort Only useful where surface land- 
horizontal plane. Relatively inex- mark and bony landmark are par- 
pensive. allel to the film plate. 
No compression of tissue while tak- | Metallic implants (braces and fill- 
ing measurement. ings) may interfere with measure- 
ments. Magnification issues. 
Computerized Widely used in medicine and den- | Expensive. 
tomography tistry. Requires exposure to ionizing 
Images are digital and easy to radiation, patient selection may 
manipulate (e.g., absorption charac- | introduce bias. 
teristic of soft and hard tissue rela- | Patient motion artifact (voluntary 
tively easy to distinguish). or involuntary) may interfere with 
Accuracy of surface landmark measurements. 
placement relative to bony landmark | Radio-opaque objects (e.g., filling, 
can be verified. braces) may distort images and 
Paired landmarks easily measured. | measurements. 
Known accuracy and Images are not in Frankfort hori- 
reproducibility. zontal plane. 
Gravity effects on soft tissue due to 
supine position. 
Translation to 3D shape may 
involve manual intervention. 
Magnetic No exposure to ionizing radiation, Very expensive. 


Resonance Imaging 


ethically acceptable to image sub- 
jects for tissue depth estimation. 
Can be repeated on same subjects to 
obtain longitudinal data. 

No soft-tissue compression during 
measurement 

Images are digital and easy to 
manipulate (e.g. absorption charac- 
teristics of soft and hard tissue rela- 
tively easy to distinguish). 
Accuracy of surface landmark 
placement relative to bony landmark 
can be verified. 


| Paired landmarks easily measured. 


Images generally not acquired in 
Frankfort horizontal plane. 
Requires exposure to high-intensity 
magnetic field, subjects with 
metallic exposure not eligible. 
Subject motion artifact distorts 
images. 

May not visualize bone well. 
Gravity effects due to supine posi- 
tion. 

Translation to 3D shape may 
involve manual intervention. 
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Method of 
measurement 


Ultrasound 


Advantage 


No exposure to ionizing radiation; 
can be used repeatedly in the same 
subject. 

Portable, can be used in the field. 
Measurements made in Frankfort 
horizontal plane. 


Disadvantage 


Probe must touch skin surface, tis- 
sue compression possible with 
inexperienced operator. 

Operating characteristics of porta- 
ble equipment differ according to 
manufacturer and must be defined 


before use. 

Difficult to scan parallel to skeletal 
surface and this can make visuali- 
zation of the surface more 
challenging. 


Taken from Taylor and Brown (1998) 


Table 3.6 Systematic bias of soft-tissue measurement according to method of measurements 


Landmarks at which tissue Landmarks at which tissue | Measurements 
depths are consistently depths are consistently technique that 

Measurement | higher than with other lower than with other most closely 

technique techniques techniques correlates 

Needle - - - 

puncture 

Plain All midline landmarks Lateral landmarks: gonion _ 

radiology and zygion 

CT scan All midline landmarks All midline points MRI 

MRI scan _ All midline points CT 

Ultrasound Supra M2, infra M2, gonion, — Needle puncture 
mid-infraorbital, anterior (except for supra 
masseter border M2) 


Taken from Preedy (2012) 


different methods used for conservation, alongside the development of rigor mortis, 
which affects the muscle fibers (Galdames et al. 2008; de Greef et al. 2006). 

Various investigators have compared the soft facial tissue thicknesses measured 
in fresh cadavers with embalmed cadavers. Simpson and Henneberg (2002) reported 
an increase in soft tissue thickness of all landmarks, due to embalming processes. 
Galdames et al. (2008) indicated that the embalmed cadavers presented larger 
thicknesses of tissue in all sites, with the exception of the right exocanthion and 
right and left gonion points. The most significant differences between fresh and 
embalmed tissue were observed at the trichion, glabella, nasion, pogonion, super- 
ciliary, supraorbital, infraorbital, and gonion points (Galdames et al. 2008; Simpson 
and Henneberg 2002). 

Postmortem data and the use of the different methods of cadaver conservation 
must be considered when comparing measurements with those obtained from living 
subjects by means of radiograph, ultrasound, computerized tomography, or nuclear 
magnetic resonance (Clement and Ranson 1998; Galdames et al. 2008). 
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The face is one of the most individualistic and unique parts of the human body. It is 
important to establish the most commonly utilized morphological features when 
carrying out an assessment of face and skull correspondence. There are many 
standards for the prediction of the soft tissue features from skeletal assessment, 
and these standards were established through human dissection, palpation, medical 
imaging modalities, and direct anthropometry of living subjects. The relative limi- 
tations of each method when evaluating the reliability of the standards produced 
should be noted. Human dissection studies offer a unique opportunity to visualize 
the face and the related skeletal structures, but are limited by the effects of 
embalming, deformation associated with a cadaver face, and dehydration. Palpation 
studies employ living faces but are limited by the inability to accurately locate bony 
landmarks, especially in the areas of the face with the greatest soft tissues. Clinical 
imaging of living faces enables the visualization of soft and hard tissues simulta- 
neously, but different imaging modalities suffer from gravitational problems (the 
subject is supine), artifacts (dental flare), bone visibility (MRI), and pressure effects 
(ultrasound). Direct anthropometry from a living subject is probably the most 
reliable form of data collection, but although multiple measurements can be col- 
lected from the soft tissues, direct measurements of the skull are limited to the teeth. 

This report will attempt to highlight the published anatomical standards feature 
by feature. 


3.3.1 General Face Shape 


The relationship between the shape of the head and the shape of the cranium is well 
established. Several classifications of this relationship have been published (Clement 
and Ranson 1998; Fedosyutkin and Nainys 1993; Balueva et al. 2009), Table 3.7 
summarizes the standards. 

The relationship between facial measurements and related skull measurements 
has also been studied (Balueva et al. 2009). Table 3.8 summarizes the standards. 


3.3.2 The Eyebrows 


Eyebrow pattern standards (Table 3.9) have been developed from a combination of 
palpation (Balueva et al. 2009) and craniograph studies (Fedosyutkin and Nainys 
1993). 
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Table 3.7 Shape relationships of head and cranium 


Morphological and 
facial traits 


Correspondence with facial structures 


The general head shape 

Shape of face Transverse arc of the cranium 

Rounded Semisphere 

Square Pentagonoid 

Oval Oval 

Triangular Rectangular 
The shape of the temporal lines provides information about the forehead 
width 

Shape of the face Mandible 

Oval If the gonial angle is over 125° and the coronoid process is high, the 
lowest part of the head is likely to be narrow 

Triangular If the gonial angle is over 125° and the coronoid process is high, the 
lowest part of the head is likely to be narrow 

Rounded If the gonial angle is less than 125°, then the face shape is likely to be 
wide 

Rectangular If the gonial angle is less than 125°, then the face shape is likely to be 


wide 


General face shape 


Rounded 


Parietal part gently curved in frontal view; occiput rounded in lateral 
view 


Dome shaped 


Parietal part protruding; occiput flattened in lateral view 


Egg shaped 


Parietal part gently curved in frontal view; occiput protruding 


Keel shaped 


Flattened 


Parietal part narrow, laterally compressed and “sharpened” in frontal 
view; gently curved or protruding in lateral view; occiput rounded, 
flattened, or protruding 

Parietal part flattened in frontal view, flattened in lateral view; occiput 
rounded or protruding in lateral view 


Saddle shape 


Parietal part gently curved or flattened, saddle shaped in lateral view; 
occiput rounded, flattened, or protruding in lateral view 


Face in frontal view 


Rounded 


As in cranial contour; malar bones prominent; general contour rounded 


Oval As in cranial contour; facial outline smooth; general contour elliptical 

Triangular As in cranial contour; frontal part wide, mandible narrow; general 
contour triangular 

Square As in cranial contour; transverse dimensions large; general contour 
square 

Rectangular As in cranial contour; frontal and mandibular widths roughly equal; face 


high, outline angular; general contour rectangular 


Diamond-shaped 


As in cranial contour; frontal and mandibular breadth small, face broad 
and high; general contour diamond shaped 


Vertical facial profile 
Sharp Nasal saddle high; malar bones not prominent 
Flattened Nasal saddle low; malar bones prominent 
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Morphological and 
facial traits 


Correspondence with facial structures 


Frontal curvature in profile 


Flat Frontal outline nearly straight 

Convex Frontal outline convex arc 

Concave Both glabella and frontal tubers developed, creating the impression of 
concavity in the middle part 

Wavy Glabella developed, well-expressed flexure between it and the upper 


part of the frontal bone 


Frontal angle in profile 


Vertical 


Perpendicular to Frankfort horizontal plane tangent to glabella nearly 
vertical 


Inclined backward 


Perpendicular to Frankfort horizontal plane tangent to glabella inclined 
backward 


Inclined forward 


Perpendicular to Frankfort horizontal plane tangent to glabella inclined 
forward 


Brow ridges 


Medium Brow ridges markedly prominent, but without a depression between 
them 

Large Brow ridges markedly prominent and separated by depression 

Small Brow ridges barely distinguishable 

Brow ridges 

Medium Moderately prominent from side view 

Large Markedly prominent from side view 

Small Barely distinguishable from side view 

Length of brow ridges 

Large Extend beyond midpoint of supraorbital margin 

Small Do not reach midpoint of supraorbital margin 


Table 3.8 Related face and skull measurements 


Relative facial breadth 


Medium | (Bizygomatic (45) + 10 mm)/(supraorbitale to gnathion (47b) + 6 mm) = 1.10 + 0.04 
Large (Bizygomatic (45) +10 mm)/(supraorbitale to gnathion (47b) + 6 mm) > 1.14 
Small (Bizygomatic (45) + 10 mm)/(supraorbitale to gnathion (47b) + 6 mm) < 1.06 
Frontal height 

Medium | (Trichion to supraorbitale)/(supraorbitale to gnathion (47b) + 6 mm) = 0.45 + 0.03 
Large (Trichion to supraorbitale)/(supraorbitale to gnathion (47b) + 6 mm) > 0.48 

Small (Trichion to supraorbitale)/(supraorbitale to gnathion (47b) + 6 mm) < 0.42 
Frontal breadth 

Medium | (Bicoronal (10) + 10 mm)/(bizygomatic (45) + 10 mm) = 0.90 + 0.02 

Large (Bicoronal (10) + 10 mm)/(bizygomatic (45) + 10 mm) > 0.92 

Small (Bicoronal (10) + 10 mm)/(bizygomatic (45) + 10 mm) < 0.88 
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Table 3.9 Eyebrow pattern standards 


Eyebrow pattern 


Overhanging | There is a strong development of the supraorbital margin and brow ridge, the 
eyebrows are shifted downward, 1-2 mm lower than the supraorbital rim 


Arched This is related to a smooth forehead and high orbit, with the eyebrow following 
the curve of the supraorbital margin 


Triangular There is thickening of the outer part of the supraorbital rim and a strong brow 
ridge, the eyebrow is arranged over the supraorbital margin forming an angle 


Outline of eyebrows 


Straight Supraorbital margin straight; superciliary arch horizontal 
Arched Supraorbital margin arcuate; lateral end of superciliary arch directed upward 
Broken Supraorbital margin wavy; lateral end of superciliary arch directed upward 


Table 3.10 Relationship between the eyeball and the orbit 
Eyes 
Protrusion of the eyeballs 


This is related to the depth of the orbital cavity, vertical inclination of the orbit, 
and the thickness and degree of overhang of its upper rim 


Deep-set eye The supraorbital rim is greatly thickened and protrudes relative to the 
infraorbital rim 
Supraorbital margin projects inferiorly (“closed orbit”) 
(orbital height (52))/(exocanthion to endocanthion) < 0.81 
Prominent eye  |Supraorbital margin does not project inferiorly 
(orbital height (52))/(exocanthion to endocanthion) > 0.81 
Eyeball Normal prominence is when the iris touches a tangent across the 
prominence mid-supraorbital to mid-infraorbital bone 
eyeball protrusion = 18.3 — (0.4 x orbit depth) 


3.3.3 The Eyes 


A number of studies assessing the relationship between the eyeball and the orbit in 
relation to prominence and frontal position have been conducted. 

Prominence studies utilizing MRI (Wilkinson and Mautner 2003) 
exophthalmometry (Stephan 2002), and palpation (Fedosyutkin and Nainys 1993; 
Balueva et al. 2009) all present results indicating a general agreement between 
current published standards (see Table 3.10). 

Studies on the position of the eyeball in the orbit from a frontal view seem to 
report different results depending on the method of assessment. Dissection studies 
(Whitnall 1921; Stephan and Davidson 2008; Stephan et al. 2003) suggest that the 
eyeball sits slightly superior (1-2 mm) and lateral to the centre in the orbit, but 
palpation studies (Balueva and Veselovskaya 2004) suggest that the eyeball sits 
2 mm closer to the medial wall than the lateral wall; other dissection studies 
(Krogman and İşcan 1986) suggest the eyeball sits centrally in the orbit. 
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The positions of the inner (endocanthus) and outer (exocanthus) corners of the eye 
have been studied in detail, but there is no clear agreement between standards. There is 
a general agreement concerning the malar (or Whitnall’s) tubercle in relation to the 
outer canthus. Human dissection has shown that the tendons that fix the eyelids to the 
orbit are inserted at this tubercle (Whitnall 1921). Although it has been established that 
the outer canthus is located at the same height as the malar tubercle, there is no 
consensus as to the distance of the outer canthus from the orbital wall. The distance has 
been published as 1 mm (Sills 2004), 3-5 mm (Balueva et al. 2009; Angel 1978; 
Krogman and Íscan 1986; Stephan 2009), 5-7 mm (Wolff 1976; Rosenstein et al. 
2000), 8-10 mm (Couly et al. 1976), and 13 mm ( Anastassov and van Damme 1996). 
Where the malar tubercle is absent, the outer canthus can be positioned 8-11 mm 
below the line of the frontozygomatic suture (Stewart 1983; Krogman and İşcan 1986; 
Wolff 1976). 

There is an agreement that the medial canthus is positioned approximately 
2-5 mm lateral to the anterior lacrimal crest (Yoshino and Seta 1989; Angel 1978; 
Sills 2004; Krogman and İşcan 1986; Stephan 2009), but where exactly on the 
anterior lacrimal crest this measurement is taken from is unclear. Different studies 
suggest the top (Balueva and Veselovskaya 2004), middle (Angel 1978), and base 
(Fedosyutkin and Nainys 1993) as the measurement point, while other studies 
suggest that the point can be found 4-5 mm (Angel 1978) or 10 mm (Stewart 
1983) below the dacryon. Table 3.11 presents the standards related to dissection 
and anthropometrical studies (Whitnall 1921; Merkel 1886). 


Table 3.11 Position of the inner (endocanthus) and outer (exocanthus) corners of the eye 


Eyes 
The slope of the fissure is defined by a straight line that connects the malar (Whitnall’s) 


tubercle on the lateral border of the orbit with the anterior lacrimal crest on the medial 
border of the orbit 


The curves of the eyelid margins are not symmetrical and the upper lid is more 
pronounced than the lower, its height being greatest nearer the medial angle, whereas 
that of the lower lid is nearer the lateral angle 

The lateral canthal angle is more acute than the medial and lies in close contact with the 
globe, whereas the medial canthus extends toward the nose 5—7 mm away from the 
globe, being separated by the caruncula and the plica semilunaris 

The radius of the upper eyelid curve is 16.5 mm and that of the lower eyelid is 22 mm 
The outer canthus (exocanthus) is positioned at the same height as the malar 
(Whitnall’s tubercle) and medial to it 

Where the malar tubercle is absent, the outer canthus can be positioned 8-11 mm 
below the line of the frontozygomatic suture 

The inner canthus (endocanthus) is situated 2-5 mm lateral to the anterior lacrimal 
crest 


Eye fissure 


The length of the eye fissure is 60-80% of the width of the orbit 


Medium | (Exocanthion to endocanthion — 14 mm)/(upper facial breadth (43) 
+ 10 mm)= 0.25 + 0.01 


Large (Exocanthion to endocanthion — 14 mm)/(upper facial breadth (43) 10 mm)» 0.26 
Small (Exocanthion to endocanthion — 14 mm)/(upper facial breadth (43)+ 10 mm)< 0.24 
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Table 3.12 Eyelid pattern 


Eyelid patterns 


Lateral There is an overhang in the lateral part of the supraorbital rim 


Central There is an overhang in the central part of the supraorbital rim 
Upper eyelid fold 
Moderate | Supraorbital margins straight or slightly rounded 


Defined | Supraorbital margins arched and sharp 
Absent Supraorbital margins arched, supraorbital overhang markedly shifted medially 


Irregular | Supraorbital margin wave shaped or oblique in distal part 

Epicanthic fold 

Present Crest descending from medial supraorbital margin directed toward anterior lacrimal 
crest 

This is characteristic of a high orbit, a low-or medium-height nasal bridge, and a long 
lacrimal fossa 


Absent Crest descending from medial supraorbital margin directed inside orbit 


The eyelid pattern has been studied using palpation and anthropometry studies 
(comparison of skulls with ante-mortem images) (Balueva et al. 2009; Rynn et al. 
2012). These standards are presented in Table 3.12. 


3.3.4 The Nose 


The nose is the most studied feature on the face; studies on the relationship between 
the configuration of the nasal tissue and the bones surrounding the nasal aperture are 
abundant (Gerasimov 1955; Macho 1986; McClintock Robinson et al. 1986; George 
1993; Schultz 2005; Tandler 1909; Virchow 1912; Glanville 1969; Prokopec and 
Ubelaker 2002; Stephan et al. 2003). Studies conducted by Gerasimov (1955) show 
that the soft nose is wider than the bony aperture, as a narrower soft nose would have 
no supporting structure. Furthermore, he suggested that the bony nasal aperture at its 
widest point is three-fifths of the overall width of the soft nose. This assertion 
has been confirmed by a CT study on living subjects of various ethnic groups 
(Rynn 2006). 

Gerasimov (1955) also suggested that the nasal base angle (the angle between the 
upper lip and the columella) is determined by the direction of the nasal spine. In his 
study, he stated that the axis of the nasal spine serves as a base for the soft nose and 
the determination of the nasal spine direction follows the point of the spine, as if it 
were an arrowhead. He also suggested that the end of the soft nose could be predicted 
as the point where a line following the projection of the last part of the nasal bones 
(at the rhinion) crosses a line following the direction of the nasal spine, and he 
confirmed these standards with a blind study of 50 cadaver heads. This standard has 
been widely debated in the literature; Ullrich, a former student of Gerasimov, 
claimed that Gerasimov did not follow the direction of the nasal spine, but rather 
the general direction of the floor of the anterior part of the nasal aperture (maxillary 
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bone) laterally adjacent to the anterior nasal spine and vomer bone (Ullrich and 
Stephan 2011). However, this is disputed by the academic group who worked for 
many years alongside Gerasimov and Lebedinskaya, and continue their work at the 
Russian Academy of Sciences in Moscow (Balueva et al. 2009; Rynn et al. 2012) 
and they confirm that the nasal spine was indeed the feature used by Gerasimov to 
determine the nasal base angle. Rynn and Wilkinson (2006) tested six different 
methods of nose prominence prediction (Gerasimov 1955; Prokopec and Ubelaker 
2002; Macho 1986; Stephan et al. 2003; George 1987; Krogman and İşcan 1986) in 
order to understand which method was the most accurate. This study found that the 
Gerasimov (1955) method performed with the most accuracy, while the Krogman 
and İşcan (1986) method performed poorly. 

Rynn (2006) produced guidelines for nasal shape prediction, utilizing three 
cranial measurements that can be used to predict six soft nose measurements. 
These guidelines were tested in a blind study showing a high level of accuracy 
(Rynn et al. 2010). 

Gerasimov (1955) also suggested that the height of the upper border of the alae is 
in line with the crista conchalis and the profile of the nose is a nonscaled mirror of the 
nasal aperture in profile. These standards have been confirmed using CT data of 
living subjects (Rynn 2006); this study additionally confirmed previous papers’ 
suggestions that deviation of the nasal tip from the midline is associated with 
opposing nasal septum deviation (Selzter 1944; Gray 1965) and that nasal tip 
bifurcation is associated with a bifid nasal spine (Weaver and Bellinger 1946). 

A recent dissection study suggested that the shape of the nasal aperture when 
viewed from posterior-anterior aspect is mirrored in the shape of the nasal tip 
(Davy-Jow et al. 2012). Standards for nose shape prediction are given in Table 3.13. 


3.3.5 The Mouth 


There are some anatomical standards relating to mouth shape, which have been 
confirmed in different populations and by a variety of methods of study (Stephan 
et al. 2003; Balueva et al. 2009; Stephan and Murphy 2008; Angel 1978; Krogman 
and İşcan 1986). These are presented in Table 3.14. 

Scientific literature from orthodontic and anatomical disciplines suggests that the 
form of the mouth is related to the occlusion of the teeth (Roos 1977; Rudee 1964; 
Koch et al. 1979; Waldman 1982; Holdaway 1983; Denis and Speidel 1987; Talass 
et al. 1987), the dental pattern (Subtelny 1959), and the facial profile (Gerasimov 
1955). These are presented in Table 3.14. 


3.3.6 The Cheeks 


Studies demonstrating the relationship between the zygomatic bones, the canine 
fossa, and the soft cheeks are presented in Table 3.15 (Fedosyutkin and Nainys 1993; 
Balueva et al. 2009). 


30 


3 Relationships Between the Skull and the Face for Forensic. . . 


Table 3.13 Standards for nose shape prediction 


Nose 
Height of the nose 
This equals the distance from nasion to 1-2 mm below the nasal spine 
Medium (Supraorbitale to subspinale)/(trichion to gnathion + 6 mm) = 0.32 + 0.015 
Large (Supraorbitale to subspinale)/(trichion to gnathion + 6 mm) > 0.335 
Small (Supraorbitale to subspinale)/(trichion to gnathion + 6 mm) < 0.305 
Nasal Europeans: nasion to prosthion = 0.74 (bony nasion to subspinale) + 3.5 
length 
Nasal Nasion to pronasale (mm) in nasion-prosthion plane — 0.9 (bony nasion to 
length acanthion) — 2 
Nasal European females: nasion to subspinale = 0.63 (bony nasion to subspinale) + 17 
height European males: nasion to subspinale = 0.78 (bony nasion to subspinale) + 9.5 
Width of the nose 
This is defined between the midpoints of the canines or their alveoli 
The maximum width of the nasal aperture is three-fifths (7/5) of the maximum width 
of the soft nose 
Medium Nasal breadth/(bizygomatic breadth (45) + 10 mm) = 0.25 + 0.01 
Large Nasal breadth/(bizygomatic breadth (45) + 10 mm) > 0.26 
Small Nasal breadth/(bizygomatic breadth (45) + 10 mm) < 0.24 


The base of the nose 


Horizontal | Horizontal nasal spine 
Elevated Up-turned nasal spine 
Prolapsed | Down-turned nasal spine 


The tip of the nose 


Bifid Bifurcated nasal spine 

Nasal Female; subspinale to pronasale = 0.5 (bony rhinion to subspinale) + 1.5 male; 

depth subspinale to pronasale = 0.4 (bony rhinion to subspinale) + 5 

Pronasale | Anterior projection (mm) perpendicular to nasion-prosthion plane= 0.83Y — 3.5 

Pronasale | Projection from subspinale in Frankfort horizontal plane = 0.93 (bony rhinion to 
subspinale) — 6 

Deviated Deviation of nose is opposite to the deviation of the nasal septum and in the same 
direction as the nasal spine (right or left) 

Wide Wider than the nose ridge. It is correlated with a short, wide, groovy, nasal spine and 
low, wide nasal foramen 

Moderate | Equal to the width of the nose ridge 

Narrow It is correlated with a long, narrow, pronounced nasal spine and long, narrow nasal 
foramen 

Rounded | Length of anterior nasal spine equal to or smaller than width of its base; tip of spine 
forming an obtuse angle 

Pointed Length of anterior nasal spine larger than width of its base; tip of spine pointed 


Wing of the nose 


The wing of the nose begins at the lateral edge of the piriform foramen at the level of 
nasal spine 

The height of the upper border of the alae is in line with the crista conchalis 

An exposed nasal septum is characteristic of a crest-shaped base of the nose 


Medium 


(Conchale to subspinale)/(supraorbitale to subspinale) = 0.21 + 0.02 


(continued) 
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Table 3.13 (continued) 


Nose 

High (Conchale to subspinale)/(supraorbitale to subspinale) > 0.23 

Low (Conchale to subspinale)/(supraorbitale to subspinale) < 0.19 

Level Left and right conchale and left and right lower points of the piriform aperture 
situated on the same level 

Right Right conchale or right lower point of the piriform aperture higher than left 

higher 

Left Left conchale or left lower point of the piriform aperture higher than right 

higher 

Nasal bridge depth 

Medium Sellion not much deeper than glabella to rhinion line 

Large Sellion much deeper than glabella to rhinion line 

Small Sellion on glabella to rhinion line 

Nasal bridge breadth 

Medium (Minimal breadth of nasal bones at nasal saddle level (57) + 6 mm)/(naso-gnathic 
left to naso-gnathic right + 6 mm) = 0.85 + 0.04 

Large (Minimal breadth of nasal bones at nasal saddle level (57) + 6 mm)/(naso-gnathic 
left to naso-gnathic right + 6 mm) > 0.89 

Small (Minimal breadth of nasal bones at nasal saddle level (57) + 6 mm)/(naso-gnathic 
left to naso-gnathic right + 6 mm) < 0.81 

Nasal saddle width 

Medium (Naso-gnathic left to naso-gnathic right + 6 mm)/(canine left to canine right) 
= 0.38 + 0.03 

Large (Naso-gnathic left to naso-gnathic right + 6 mm)/(canine left to canine right) > 0.41 

Small (Naso-gnathic left to naso-gnathic right + 6 mm)/(canine left to canine right) < 0.35 
Nasal ridge index = minimal breadth of nasal bone x 100/anterior length of nasal 
bone 
10-30 = narrow; 30-45 = medium; 45-75 = broad 


3.3.7 The Ear 


Although there have been some studies relating ear morphology to skeletal structure, 
this facial feature is understudied. Gerasimov (1955) considered the angle of ear to 
be parallel to the jaw line and stated that when the mastoid processes are directed 
downward (in the Frankfort Horizontal Plane), the earlobe will be attached (adherent 
to the soft tissue of the cheek), whereas, where the mastoid processes point forward, 
the ear lobe will be free. However, recent dissection studies disagree as to the 
reliability of these standards; Renwick (2012) confirmed that adherent ear lobes 
relate to downward pointing mastoid processes, while studies using CT data showed 
no relationship between these features (Guyomarc'h and Stephan 2012). The con- 
firmed standards are presented in Table 3.16. 
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Table 3.14 Anatomical standards relating to mouth shape 


Mouth 
Width of the mouth 
Equal to the distance between the mandibular second molars 
Mouth corners positioned on radiating lines (perpendicular to the 
palate arc) from the first premolar—canine junction 
Intercanine distance = 75% of overall mouth width 
The distance between the first premolars equal to mouth width 
Mouth corners positioned vertically below the infraorbital foramina 
Medium Estimated on regression equation mouth width/(bigonial 
breadth + 20 mm) = 0.52 + 0.02 
Large Estimated on regression equation mouth width/(bigonial 
breadth + 20 mm) > 0.54 
Small Estimated on regression equation mouth width/(bigonial 


breadth + 20 mm) < 0.50 


Position of the fissure 


Height of the lips 


The closed fissure is positioned at the level of the upper edge of the 
anterior teeth of the mandible 

The open fissure is positioned at the mid-line of the maxillary 
incisors 


Approximately equal to the height of the enamel of the upper and 
lower incisors 

European: maximum upper lip height (mm) = 0.4 + (0.6 x max. 
maxillary tooth enamel height) 

European: maximum lower lip height (mm) = 5.5 + (0.4 x max. 
mandibular tooth enamel height) 

Indian subcontinent: maximum upper lip height 

(mm) = 3.4 + (0.4 x max. maxillary tooth enamel height) 

Indian subcontinent: maximum lower lip height 

(mm) = 6 + (0.5 x max. mandibular tooth enamel height) 


Medium (Subspinale to supradentale)/(supraorbitale to gnathion (2) + 6 mm) 
= 0.12 + 0.011 

High (Subspinale to supradentale)/(supraorbitale to gnathion (2) + 6 mm) 
> 0.131 

Low (Subspinale to supradentale)/(supraorbitale to gnathion (2) + 6 mm) 


< 0.109 


Width of the philtrum 


Prognathism 


The width of the philtrum corresponds to the distance between the 
midpoints of the upper central incisors 


Overbite or maxillary 
prognathism 


The upper lip projects more anteriorly than the lower lip 


An underbite or edge-to- 
edge occlusion 


The lower lip protrudes more anteriorly than the upper lip 


(continued) 
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Table 3.14 (continued) 


Mouth 


Line between closed lips 


Arched (upward or 
downward) 


The direction of these lines generally coincides with the line 
formed when the teeth are closed 


Straight (upward or 
downward) 


Occlusion and malocclusion 


Edge-to-edge bite 


Upper and lower anterior teeth fitting together edge-to-edge 


Moderate overbite 


Anterior upper teeth slightly projecting over lower ones 


Roof-shaped 


Marked overbite 


Cornice-shaped bite 


Marked maxillary and mandibular alveolar prognathism 


Stepwise Anterior mandibular teeth projecting anteriorly relative to anterior 
maxillary teeth 

Gaping Anterior maxillary and mandibular teeth curved and not fitting 
together 

Oblique Some teeth fit together normally, others show malocclusion 


Table 3.15 Relationship between the zygomatic bones, the canine fossa, and the soft cheeks 


Horizontal profile of the face 


The cheekbones define the width of the face and its horizontal profile 


The horizontal profile of the face depends on the width and height of the 
curvature of the cheekbones, the depth of the canine fossae, and the 
nasomalar and zygomaxillary angles 


Size of malar bones 


Medium 


Malar bones medium width and gently inclined backward; (bizygomatic 
breadth (45) + 10 mm)/(minimal frontal breadth (9) + 10 mm) 
= 1.37 + 0.03 


Large Malar bones wide and frontally positioned; (bizygomatic breadth 
(45) + 10 mm)/(minimal frontal breadth (9) + 10 mm) > 1.40 
Small Malar bones narrow and inclined backward; (bizygomatic breadth 
(45) + 10 mm)/(minimal frontal breadth (9) + 10 mm) < 1.34 
Smile line 


The nose-cheek (nasolabial) fold extends from the upper edge of the 
nostril toward the upper first molar 


Protrusion of the smile 


line 


It depends on the depth of the following parts: 

* The canine fossa 

* The degree of horizontal face profiling 

* The projection of the frontal surface of the cheekbones 
* The presence or absence of teeth 


Nose-cheek folds 


The canine fossae are deep, and profiling of the face is strong 


pronounced 

Depth of the canine fossa 

Shallow Up to 3 mm 
Moderate Between 4 and 6 mm 


Deep 


Over 6 mm 
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Table 3.16 Relationship between ear morphology and skeletal structure 


Ear 


The tragus of the ear corresponds to the upper rim of the external auditory meatus 


The height of the ear approximates the length of the nose 


Protrusion of the ear 


Upper The supramastoid crest on the temporal bone is strongly developed and protrudes 
Lower The outer surface of the mastoid process is rough 

Total All these features are present 

Lobe of the ear 

Lobe The mastoid processes are directed downward when the skull is in the Frankfort 
attached horizontal plane 

Lobe free The mastoid points forward when the skull is in the Frankfort horizontal plane 


3.3.8 The Chin 


There are some standards relating the mental region of the mandible to chin shape 
(Balueva et al. 2009). These are presented in Table 3.17. 

The facial proportions are an important element to understanding facial geometry. 
The aim of the facial proportion assessment is to establish the variation from the 
ideal dimensions of the human form. This, combined with anthropometric norms, 
gives information about facial features as a symmetrical and balanced pattern, based 
on statistical means taking into account variations in age, sex, and ancestry. In this 
way, George (1993) described facial proportions based on the studies of Farkas and 
Munro (1987), Powell and Humphreys (1984). 


3.4 Examination Criteria for Craniofacial Superimposition 


Assessment of the quality of the matching and anatomical consistency between the 
face and skeletal structures for CFS has been carried out following a number of 
different criteria. These include the works of Helmer (1987), Helmer et al. (1989), 
Powell and Humphreys (1984), Chai et al. (1989), Austin-Smith and Maples (1994), 
Yoshino et al. (1995), Yoshino (2012), Lan (1995), Jayaprakash et al. (2001), Ricci 
et al. (2006), Ishii et al. (2011), and Gordon and Steyn (2012). These criteria are 
presented in detail below. 


3.4.1 Helmer (1984, 2012) 


This method of assessment includes the use of several soft tissue thickness markers, 
attached to the skull along a vertical central line. Helmer employed average German 
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Table 3.17 Relationship between the mental region of the mandible and chin shape 


The presence of convexities in the lower part of the mandibular body is a notable 
feature both of the skull and of the face. 


Width of the chin 


This is defined by the degree of elevation in the mental region of the mandible and 
the width its base. 


Shape of the chin 
High The height of the mandibular body diminishes from the chin triangle to the rami. 


Wide Everted gonial regions of the mandible are associated with the wider variants of the 
lower face and more developed masseter muscles. 


Height of the chin 


Medium (Supramentale to gnathion + 6 mm)/(supraorbitale to 

gnathion + 6 mm)= 0.215 + 0.015 
Large (Supramentale to gnathion + 6 mm)/(supraorbitale to gnathion + 6 mm) > 0.23 
Small (Supramentale to gnathion + 6 mm)/(supraorbitale to gnathion + 6 mm) < 0.20 


Chin height index = Height of the chin triangle x 100/Height of the ramus along the 
second premolar 

100-110 = normal; 110-115 = high; 115-120 = very high 

Chin prominence 


Straight Most projecting point of chin slightly anterior to vertical line 


Prominent | Most projecting point of chin markedly anterior to vertical line 


Receding | Most projecting point of chin on vertical line or behind it 

Width of the chin 

Medium (Mentale left to mentale right)/(bigonial width + 20 mm)= 0.35 + 0.02 
Large (Mentale left to mentale right)/(bigonial width + 20 mm) > 0.37 

Small (Mentale left to mentale right)/(bigonial width + 20 mm) < 0.33 

Shape of the chin in frontal view 


Rounded | Outline rounded, genial tubercles unexpressed 


Triangular | Outline pointed, genial tubercles close together 


Square Outline square, genial tubercles wide apart 


soft tissue data (Helmer 1984) collected by ultrasound. These cephalometric land- 
marks (nasion, rhinion, gonion, gnathion) are then matched to the profile on the ante- 
mortem photograph. The alignment of these landmarks indicates a positive identi- 
fication. Variations on this methodology have been employed. Bajnóczky and 
Királyfalvi (1995) suggested a digital method to mark the superimposed ante- 
mortem photograph and skull image. The coordinate values of these points were 
then recorded and expressed as pixel units. Birngruber et al. (2010) glued 53 markers 
to the skull to mark the tissue depth at each anthropological landmark (Helmer 
1984). The skull and the ante-mortem photograph were then superimposed in order 
to assess whether or not the tissue markers matched with the contours of the face. 
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Table 3.18 Landmarks, lines, and profile curves suggested by Chai et al. (1984) 


Landmarks on face and skull Facial lines Skeletal lines Profile outlines 
g: glabella ex-ex ec-ec Cranial vault 
tr: trichion g-gn g-gn Brow ridge 

V: vertex se-se se-se Nasal 

n: nasion ch-ch -gn- Gonial angle 
sn: subnasal en-eh Lower Jaw 

gn: gnathion en-eh Occipital 

pg: pogonion -gn- Forehead 

rhi: rhinion Chin 

ns: nasospinale Zygomatic 


pr: prosthion 


inf: infradentale anterior 


t: tragion 


eu: euryon 


al: alare 


che: cheilion 
en: endocanthion 


ex: exocanthion 


Zy: zygion 
go: gonion 


ca: caninion 


se: superciliary 


ec: ectoconchion 


3.4.2 Chai et al. (2010) 


This method is based on a study of 224 Chinese subjects (100 males and 124 females) 
aged between 18 and 55 years, from X-ray images. The protocol relies on the 
analysis of positional relationships between homologous facial and skull landmarks, 
the thickness of soft tissue at specific points, and the fit of facial outlines with the 
cranial structures. Fifty-two indices were established as a standard for CFS and 
identification (Table 3.18). 


3.4.3 Austin-Smith and Maples (1994) 


Two sets of 12 criteria are employed in this method to analyze skull-face consistency 
using lateral and frontal view photographs. Relevant soft tissue thickness data is also 
utilized along with the anatomical criteria. The authors suggest that with anterior 
dentition, skull/photograph superimposition is reliable when two or more photo- 
graphs are used in the identification. The following features were used for a 
consistent fit between skull and face: 
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W 


11. 


12. 


Lateral View 


. The vault of the skull and the head height must be similar. 
. The glabellar outline of both the bone and the soft tissue must have a similar 


slope, although the line of the face does not always follow the line of the skull 
exactly. There may be slight differences in soft tissue thicknesses that do not 
relate to nuances in the contour of the bone. 


. The lateral angle of the eye lies within the bony lateral wall of the orbit. 
. The glabella, nasal bridge, and nasal bone area is perhaps the most distinctive. 


The prominence of the glabella and the depth of the nasal bridge are closely 
approximated by the soft tissue covering this area. The nasal bones fall within 
the structure of the nose and the imaginary continued line, composed of the 
lateral nasal cartilages in life, will conform to the shape of the nose except in 
cases of noticeable deformity. 


. The outline of the frontal process of the zygomatic bones can normally be seen 


in the flesh of the face. The skeletal process can be aligned with the process seen 
in the face. 


. The outline of the zygomatic arch can be seen and aligned in those individuals 


with minimal soft tissue thickness. 


. The anterior nasal spine lies posterior to the base of the nose near the most 


posterior portion of the lateral septal cartilage. 


. The porion aligns posterior to the tragus and inferior to the crus of the helix. 
. The prosthion lies posterior to the anterior edge of the upper lip. 
. The pogonion lies posterior to the indentation observable in the chin where the 


orbicularis oris muscle crosses the mentalis muscle. 

The mental protuberance of the mandible lies posterior to the point of the chin. 
The shape of the bone (pointed or rounded) corresponds to the shape of the chin. 
The occipital curve lies within the outline of the back of the head. This area is 
usually covered with hair and the exact location may be difficult to judge. 


Frontal View 


. The length of the skull from bregma to menton fits within the face. Bregma is 


usually covered with hair. 


. The width of the cranium fills the forehead area of the face. 
. The temporal line can sometimes be distinguished on the photograph. If so, the 


line of the skull corresponds to the line seen on the face. 


. The eyebrow generally follows the upper edge of the orbit over the medial 


two-thirds. At the lateral superior one-third of the orbit, the eyebrow continues 
horizontally as the orbital rim begins to curve inferiorly. 


. The orbits completely encase the eyes including the medial and lateral folds. The 


point of attachment of the medial and lateral palpebral ligaments can usually be 
found on the skull. These areas align with the folds of the eye. 


. The lacrimal groove can sometimes be distinguished on the photograph. If so, 


the groove observable on the bone aligns with the groove seen on the face. 
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7. The breadth of the nasal bridge on the cranium and surrounding soft tissue is 
similar. In the skull, the bridge extends from one orbital opening to the other. In 
the face, the bridge spreads between the medial palpebral ligament attachments. 

8. The external auditory meatus opening lies medial to the tragus of the ear. The 
best way to judge this area is to place a projecting marker in the ear canal. On 
superimposition, the marker will appear to exit the ear behind the tragus. 

9. The width and length of the nasal aperture falls inside the borders of the nose. 

10. The anterior nasal spine lies superior to the inferior border of the medial crus of 
the nose. With advanced age, the crus of the nose begins to sag and the anterior 
nasal spine is located more superiorly. 

11. The oblique line of the mandible (between the buccinator and the masseter 
muscles) is sometimes visible in the face. The line of the mandible corresponds 
to the line of the face. 

12. The curve of the mandible is similar to that of the facial jaw. At no point does the 
bone appear to project from the flesh. Rounded, pointed, or notched chins will 
be evident in the mandible. 


3.4.4 Yoshino et al. (1995, 2012) 


This method evaluates the anatomical consistency between skull and face by means 
of video superimposition. The anatomical relationships and soft tissue thickness data 
is based on Ogawa's data (Ogawa 1960). The exact thicknesses of soft tissue at the 
anthropometrical points of the skull are measured on the superimposed transparent 
films by using a sliding caliper. Eighteen assessment criteria are used for the 
evaluation of the anatomical consistency between the face and the skull. The criteria 
used are divided into three types: outlines, soft-tissue thickness, and positional 
relationships (Tables 3.19, 3.20, and 3.21). The authors suggest a positive identifi- 
cation can be achieved if 13 or more criteria demonstrate concordance between the 
skull and the face. 


3.45 Lan (1995) 


This method is based on a study of 3123 subjects from 15 nationalities (1554 males 
and 1569 females), with one front view and one profile photograph of each subject. 
The method includes anthropometry from photographs and X-rays. A total of 
69 indices are established for identification (Table 3.22). The authors noted that 
some indices showed significant differences between different nationalities: the 
distance between the vertical line of ectocanthion and gonion; the distance between 
gonions; and the thickness of the soft tissue at the trichion, opisthocranion, and 
sellion. 
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Table 3.19 Examination criteria for the assessment of anatomical consistency between the skull 


and the face 


Soft tissue 
Outline thickness Positional relationships 
1. Forehead 1. Zygion 1. Distance from the supraorbital margin to the midline of 
line eyebrow 
2. Buccal line | 2. Gnathion 2. Distance from the medial orbital margin to the endocanthion 
3. Mandibu- |3. Pogonion |3. Distance from the lateral orbital margin to the ectocanthion 
lar line 
4. Nasal dor- | 4. Gonion 4. Eye-slit standard ratio (eye-slit height from the lower orbital 
sum line margin/orbital height) 
= 5. Nasion 5. Distance from the lateral margin of nasal aperture to the ala 
= 6. Rhinion 6. Distance from the lower margin of nasal aperture to the lowest 


portion of external nasal tip 


7. Subnasale 


7. Placement of the cheilion to upper teeth 


Taken from Yoshino et al. (1995) 


Table 3.20 Criteria for assessing anatomical consistency between skull and face in frontal view 


Outline Soft-tissue thickness | Positional relationship 

Skull Face Skull Face Skull Face 

Temporal line | Forehead | Zygion Zygion Supraorbital margin Eyebrow 

Lateral line of | Cheek Gonion Gonion Medial orbital margin Endocanthion 

zygomatic outline 

bone 

Mandibular Lower Gnathion | Gnathion | Lateral orbital margin Ectocanthion 

line jaw (Whitnall’s malar 

outline tubercle) 

= _ _ _ Orbit Eye-slit 

_ _ _ _ Lateral margin of Alare 
piriform aperture 

= _ = x Cutting edge of upper Stomion 
central incisor 

- - - - Teeth (premolar) Cheilion 

= _ _ _ Occlusal line Oral slit 


Taken from Yoshino (2012) 


3.4.6 Jayaprakash et al. (2001) 


This is a craniofacial morpho-analytical approach, based on the shape correlation 
between the skull and face photograph. This approach relies on previous work 
developed by Lan (1995), İşcan (1993), Farkas (1981), and George (1987, 1993) 
and special attention is placed on the nasal region. The facial and skull traits and 
attributes, and the measurements employed for this study are detailed in Tables 3.23, 
3.24, and 3.25. 
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Table 3.21 Criteria for assessing anatomical consistency between skull and face in lateral/ 
oblique view 


Outline Soft-tissue thickness Positional relationship 
Skull Face Skull Face Skull Face 
Frontal bone | Forehead | Trichion Trichion | Supraorbital margin Eyebrow 
contour outline 
Outline from | Nasal Glabella Glabella | Lateral orbital margin | Ectocanthion 
nasion to dorsum (Whitnall's malar 
rhinion line tubercle) 
Mental Chin Nasion Nasion Nasion Higher than 
outline outline nasal root 
Gonial Jaw angle | Rhinion Rhinion Lateral margin of Alare 
outline outline piriform aperture 
- €: Slightly infe- | Subnasale | Lower margin of Subnasale 
rior to piriform aperture 
nasospinale 
_ _ Pogonion Pogonion | Incisor Stomion 
_ _ Gnathion Gnathion | Teeth (canine Cheilion 
premolar) 


Taken from (Yoshino et al. 1995) 


3.4.7 Ricci et al. (2006) 


The authors presented an algorithm for identification using CFS. Fourteen subjects 
and their matching facial photographs and skull radiographs were selected. The 
algorithm calculated the distance of each transferred cross (anatomical points) and 
the corresponding average. Their results indicate that the smaller the mean value, the 
greater the index of similarity between the face and the skull. A total of 196 cross- 
comparisons were carried out. The following tables present the anatomical points 
that were located and marked with a cross on each facial image (Tables 3.26 and 
3.27). 


3.4.8 Ishii et al. (2011) 


This method was based on a study of three subjects, a young man (23 years old), a 
man with an edentulous upper jaw (36 years old), and a woman (40 years old), using 
3D CT data for CFS. Miyasaka (1987), Suzuki (1948), and Ichikawa (1975) studies 
were used for the morphological assessment technique (Table 3.28). 
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Determining lines 


Landmarks 
index 


Index of soft 
tissue 
thickness 


Index number of index 


1. Ectocanthion line. Superciliary and | Vertex Endocanthion: Distance 
Between two ectocanthions, | supraorbital line between endocanthion and 
used as a horizontal base supraorbital/orbital height 
line to mark the horizontal 

relationship of the 

superimposition. 

2. Front central line. From Orbital height Euryon Ectocanthion: Distance 
glabella to gnathion, vertical between ectocanthion and 
to the ectocanthion line, supraorbital/Orbital height 
used to mark the vertical 

relationship of the 

superimposition. 

3. Superciliary line. Ectocanthion Zygion Distance between 
Between two superciliaries, | and supraorbital Endocanthions: Distance 
parallel with the line between bi-endocanthions/ 
ectocanthion line, and verti- Distance between junctures 
cal to the front central line. of external orbit 

4. Subnasal line. At the Endocanthion Tragion Distance between 
subnasale, vertical to the and supraorbital Ectocanthions: Distance 
front central line, used to line between bi-ectocanthions/ 
mark the superimposition of Distance between junctures 
subnasale and infra-apertura of external orbit 
piriformis. 

5. Cheilion line. Between Subnasale and Gonion Stomion line: Distance 
two cheilions, vertical to infra-apertura between supradental alveo- 
front central line, used to piriformis lus and stomion line/Dis- 
mark the superimposition of tance between infradental 
cheilion and maxillary teeth. alveoli and stomion line 

6. Gnathion line. At Cheilion line and | Gnathion Distance between gonions: 
gnathion, vertical to the infra-apertura Distance between gonions 
front central line, used to piriformis on skull/Distance between 
mark the superimposition of gonions on human image 
soft tissue of gnathion and 

pogonion. 

7, 8. Endocanthion vertical | Endocanthion Opisthocranion | Distance between 

lines (left and right). From vertical line to cheilions: Distance 

the endocanthion line to the | maxillary tooth between cheilions/ 
cheilion line, parallelwith (left) Distancebetween gonions 
the front central line, used to on skull 

mark the relationship of 

endocanthion and maxillary 

teeth. 

9, 10. Ectocanthion vertical | Endocanthion Trichion - 


lines (left-right). From the 
ectocanthion line to the 
gonion line, parallel with the 
front central line, and are 


vertical line to 
maxillary tooth 
(right) 


(continued) 
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Index of soft 


Landmarks tissue 
Determining lines index thickness Index number of index 
used to mark the horizontal 
superimposition of 
ectocanthion and gonion. 
Morphological curves Distance Glabella = 


include the following: 

(1) head vault curve, 

(2) arcus superciliary curve, 
(3) nose curve, (4) lower jaw 
curve,(5) gonion curve, 

(6) head back curve, 
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(8) pogonion curve, and 

(9) zygomatic curve. 
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Table 3.26 Anatomical points of the face 


Anatomical points of the face 


Eyebrow midpoint 


Midpoint of the inferior margin of the palpebra inferior (lower eyelid) 


Inner canthus 


Outer canthus 


The most forward point of the midsagittal plane (located between the two eyebrows) 
Point below the inferior margin of the cartilaginous septum of the nose 


Superior margin of the upper lip midpoint 


Inferior margin of the lower lip midpoint 


Zygoma 


Table 3.27 Points of the skull X-rays 
Points of the skull X-rays 


Arcus superciliaris midpoint (superciliary arch) 


Inferior orbital rim midpoint 


Inner canthus, placed 3 mm medially to the medial wall of the orbitl or against the medial wall of 
the orbit2 or 2-3 mm laterally to the lacrimal crest and 4-5 mm below the dacryon (junction of the 
lacromaxillary suture and the frontal bone)3 


Outer canthus, placed 5 mm laterally to the orbit marginl or 3-4 mm medially to the “Whitnall’s 
malar tubercle”3; the *Whitnall's malar tubercle,” placed on the orbital surface of the zygomatic 
bone 11 mm below the frontozygomatic suture, is the site of attachment of the rectus lateralis bulbi 
muscle, suspensory ligament, and levator palpebrae superioris muscle 4 

Glabella 


Inferior margin of the nasal spine 


Upper infradental point (between the two medial upper incisors) 


Lower infradental point (between the two medial lower incisors) 


Zygomatic process of the maxilla 


Table 3.28 Anthro- Landmarks 

pometrical points used for lx 

each individual 
R-zy L-ex 
L-zy sn-ns 
gn R-al 
R-go L-al 
L-go R-ch 
R-en L-ch 
L-en _ 


n nasion, R-zy right zygion, L-zy left zygion, gn gnathion, R-go 
right gonion, L-go left gonion, R-en right endocanthion, L-en left 
endocanthion, R-ex right exocanthion, L-ex left exocanthion, sn-sn 
subnasal-subnasal, R-al right alare, L-al left alare, R-ch cheilion, 
L-che left cheilion 
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Table 3.29 Orientation, primary, and secondary landmarks 


Methods Description 

Orientation landmarks 

Ectocanthion (ec) Should overlap: used to define the orientation 

Subnasal point (ns) 

Nasion (n) 

Primary landmarks 

Glabella (g) Expected to be very close on skull and face, landmarks should touch or 
Dacryon (d) overlap 

Frontotemporale (ft) 

Secondarylandmarks 

Gonial angle (go) Bone and soft tissue landmarks not expected to overlap exactly but 
Gnathion (gn) bony landmarks should be inside soft tissue landmarks 


Zygion (zy) 
Nasal aperture width/ 
alare (al) 


The description of the landmark on the skull (bony landmark) and the corresponding soft tissue 
landmark is given. Taken from Gordon and Steyn (2012) 


3.4.9 Gordon et al. (2006) 


The authors studied three methods: basic morphological matching (Austin-Smith 
and Maples 1994), landmark matching, and a combination of both approaches. The 
bony and soft tissue landmarks used were based on Martin and Saller (1957) and 
Farkas (1981). They proposed three different sets of landmarks for orientation and 
evaluation purposes for CFS (see Table 3.29). 
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Chapter 4 F y 
Craniofacial Superimposition Techniques es 


4.1 Introduction 


The technological support for craniofacial superimposition (CFS) techniques used in 
the initial identifications found in the literature involved a large number of very 
diverse approaches. This could also be the reason for the current diversity of CFS 
methods and their terminology, as mentioned before. Rather than following a 
uniform methodology, every expert tends to apply his/her own approach to the 
problem, based on the available technology and his/her own knowledge of human 
craniofacial anatomy, soft tissues, and their relationships. Therefore, CFS 
approaches have evolved as new technology has become available, although their 
foundations were previously laid. Some of these approaches were classified in a 
review by Aulsebrook et al. (1995) according to the technology used to acquire the 
data and to support the skull-face overlay (SFO) and identification processes, that is, 
static photographic transparency, video technology, and computer graphics. 

Similar classification schemes have been reported by other authors, which 
describe how CFS has passed through three phases: photographic superimposition 
(developed in the mid-1930s), video superimposition (widely used since the second 
half of the 1970s), and computer-aided superimposition (introduced in the second 
half of the 1980s) (Nickerson et al. 1991; Aulsebrook et al. 1995; Yoshino and Seta 
2000). Moreover, Yoshino et al. (1997) classified some of the computer-aided CFS 
methods into two categories from the viewpoint of the identification strategy. The 
first strategy is to digitize the skull and face photographs and then morphologically 
compare the two images by image processing. The second is to evaluate the fit 
between the skull and facial images by morphometric examination. Notice that the 
latter contributions are prior to the image-processing boom of the last decade. 
Indeed, important issues like 3D modeling and machine learning are neglected. In 
the case it was used, the computer was usually considered just as a secondary support 
for the technique even when authors claim they followed a “computer-aided” 
approach (Ubelaker et al. 1992; Ricci et al. 2006). 
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Recently, Damas et al. (2011) surveyed existing methods considering a new 
computing-based classification criterion. This criterion is more related to the use 
of computers during the different stages of the CFS process itself. They defined the 
different stages involved in the craniofacial process to properly characterize any CFS 
system (and specifically computer-aided ones). These stages: face enhancement and 
skull modeling, SFO, and decision making: 


° The first stage involves achieving a digital model of the skull and the enhance- 
ment of the image of the face. This stage is not present in all the systems. Indeed, 
the oldest systems and most of the recent ones still acquire a photograph and/or a 
series of video shots of the skull, instead of building a 3D model of it. 
Concerning the image of the face, most recent systems use a 2D digital image. 
This stage also involves the application of image-processing techniques 
(Gonzalez and Woods 2008) to enhance the quality of the image of the face 
that was typically provided when the person disappeared. 

° The second stage is the SFO. It consists of searching for the best overlay of either, 
a 2D image of the skull and face or the 3D model of the skull and 2D image of the 
face acquired during the first stage. 

° Finally, the third stage of the CFS process corresponds to the decision making. 
Based on the SFO achieved, the identification decision is made by investigating 
the outline and soft-tissue thickness at various anthropometric landmarks and 
positional relationships of the skull to face parts based on anatomical data. 


This categorization of the superimposition process will be taken into account 
throughout the current document when reviewing all work carried out in the field. 


42 Photographic Craniofacial Superimposition 


Identification by photographic superimposition is a technique that began to be 
developed in the middle of the 1930s. The first superimposition was probably 
made in 1885 by Welcker and His, who used an outline drawing of the skull in 
relation to drawings of the deceased’s death mask. From the beginning, their studies 
of the relationship between soft and bony tissues were taken as a basis for developing 
new studies and different methodologies in this forensic area. Following this, many 
authors performed different measurements of the soft and hard tissues in order to 
make reconstructions of their subject’s face for sculptures and paintings. In some 
cases, these studies were focused on making a comparison between the reconstruc- 
tion and the actual face represented in paintings. The appearance of the photographic 
CFS technique allowed for the first time the comparison of an unknown skull with 
facial images of the presumed deceased. Its evolution has resulted in a variety of 


Mn this case, the first stage would be better named “face and skull data acquisition.” 
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techniques and tools depending on several factors, ranging from the skull conserva- 
tion, to the quality of the images and the knowledge of the expert who proposed it. 

We can consider the acquisition of a painting, contour, or photograph of both the 
skull and face, the replication of the skull size and its orientation with respect to the 
facial photograph of the presumed victim, and the assessment of the anatomical 
consistency between the face and the skull as common tasks in photographic CFS. A 
clear relation with the three stages identified before can be seen with the most 
common tasks to be carried out in each of them as follows: 


— Face enhancement and skull modeling: In this first stage, one or more photo- 
graphs of the skull have to be taken. The quality of the employed photographs 
will be related to the quality of the photographic equipment used in the acquisi- 
tion. In particular, the type of lens, the focal length and the distance, and position 
of the subject together with other factors are responsible for producing deforma- 
tions. Many authors have drawn tracings of the face and/or skull to facilitate the 
superimposition process. 

— Skull-face overlay: Almost every author has created their own methodology to 
project both images, using craneoforos, images with transparencies, or other 
mechanisms that allow placing the skull and facial photographs in the same 
position. In addition, some authors made use of anatomical landmarks to make 
the overlay process easier. 

— Decision making: In most of the cases, the decision was based on subjective 
features due to the lack of soft tissue studies and the difficulty to perform 
measurements on photographs. 


The scientific literature on the implementation of photographic CFS is presented 
in Table 4.1. Only the methodology followed within the stages of face enhancement 
and skull modeling and skull face overlay is summarized, as no significant contri- 
butions were made on the decision-making stage of the process. 

In the following subsections, the different photographic CFS proposals and their 
contribution to each of the CFS stages are reviewed. 


4.2.1 Face Enhancement and Skull Modeling 


In this first stage, the initial steps are intended to select and/or obtain clear and 
measurable images. The most important factors affecting the quality of the portrait to 
be superimposed that have been taken into account are the selection of the ante- 
mortem image, the knowledge of all the technical details of the photographic 
equipment, the focal length, the distance to the camera, etc. (see Table 4.2). In the 
case of the skull, this could sometimes include working with fragmented remains. In 
particular, Cocks (1971) developed a photographic CFS methodology, which was 
also applied to fragmented skulls. Moreover, in order to obtain measurable images, a 
few workers have followed the example of Glaister and Brash (1937) in using 
objects of known size, external to the person, to establish a magnification factor 
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Table 4.1 Review of the literature on photographic superimposition methods 


Stage 


Face enhancement and skull modeling 


Authors 


Location of anthropometric measurements 


Location of measurable objects 


Simpson (1943), Sekharan (1971), Reddy 
(1973), Sognnaes (1980), McKenna et al. 
(1984), Brocklebank and Holmgren (1989), 
Lan (1992) 

Glaister and Brash (1937), Gordon and 
Drennan (1948), Gruner and Reinhard (1959), 
Sekharan (1971), Janssens et al. (1978) 


Location of anatomical landmarks 


Webster (1955), Dorion (1983), Maat (1989) 


Location of special characteristics 


Brocklebank and Holmgren (1989) 


Draw tracings or outlines of the face and skull 


Peason and Morant (1934), Glaister and Brash 
(1937), Gordon and Drennan (1948), Prinsloo 
(1953), Reddy (1973) 


Reconstruct fragmented skulls 
Replicate the exact photographic conditions 


Cocks (1971) 
Scully and Nambiar (2002) 


Skull face overlay 


Size replication using measurable objects 


Glaister and Brash (1937), Gordon and 
Drennan (1948), Sekharan (1971), Janssens 
et al. (1978) 


Size replication using anthropometric 
measurements 


Simpson (1943), Sekharan (1971), Reddy 
(1973), Sognnaes (1980), Brocklebank and 
Holmgren (1989) 


Size replication using anatomical landmarks 


Use of pivoting head, skull holding, phantom- 
head, or pan-and-tilt device 


Dorion (1983) 

Sekharan (1971), Dorion (1983), Mackenna 
et al. (1984), Brocklebank and Holmgren 
(1989) 


Geometrical method to calculate projections of 
anthropometric distances, angles of rotation, 
and inclination of the head 


Maat(1989) 


Distance calculation between skull and camera 


Gruner and Reinhard (1959), Dorion (1983) 


Use of asymmetrical features of the facial 
skeleton to assess the matching 


Prinsloo (1953) 


Landmark matching 


Glaister and Brash (1937), Reddy (1973) 


Match of the tracings, outlines, negatives, 
transparencies or X-ray of the face and skull 


Peason and Morant (1934), Glaister and Brash 
(1937), Gordon and Drennan (1948), Webster 
(1955), Gruner and Reinhard (1959), Reddy 
(1973), Mackenna et al. (1984), Brocklebank 
and Holmgren (1989) 


Triangulation system based on landmarks 


Cocks (1971) 


Importance of photographic perspective 


Klonaris and Furue (1980) 


Furue’s methodology validation 


Scully and Nambiar (2002) 


for photographic enlargement, presumably because such objects are not always 
present or clear in ante-mortem photographs (see Fig. 4.1). When present, features 
of articles of clothing that lie in roughly the same focal plane as the face have been 
used. Enlargements of snapshots or photographic portraits based on the dimensions 
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Table 4.2 Review of the literature on video superimposition methods 


Stage 


Face enhancement and skull modeling 


Author 


Location of anthropometric 
measurements 


Bastiaan et al. (1986), Jayaprakash et al. (2001, 2010) 


Location of anatomical landmarks 


Koelmeyer (1982), Dorion (1983), Bastiaan et al. 
(1986), Mackenna (1988), Austin-Smith and Maples 
(1994), Fenton et al. (2008) 


Location of useful morphological 
characteristics 


Austin (1999) 


Location of tissue thickness markers 


Austin-Smith and Maples (1994), Fenton et al. 
(2008) 


Skull face overlay 


Replication of the exact photographic 
conditions 


Iten (1987) 


Size replication using anthropometric 
measurements 


Bastiaan et al. (1986), Jayaprakash et al. (2001, 2010) 


Size replication using tissue thickness 
markers 


Austin-Smith and Maples (1994) 


Size replication using anatomical 
landmarks 


Koelmeyer (1982), Bastiaan et al. (1986), Mackenna 
(1988) 


Size replication using zoom 


Iten (1987), Solla and İşcan (2001) 


Size replication using focal length and 
the focusing of the video camera 


Shahrom et al. (1996) 


Orientation using landmarks 


Solla and İşcan (2001) 


Orientation by trial and error 
manipulation 


Austin-Smith and Maples (1994) 


Dynamic orientation process 


Fenton et al. (2008) 


Use of pivoting head, skull holding, 
phantom-head, or pan-and-tilt device 


Sekharan (1988, 1993), Jayaprakash et al. (2001, 
2010) 


Distance calculation between skull and 
camera 

Tracings, outlines, negatives, or trans- 
parencies matching 


Dorion (1983) 


Helmer and Grüner (1977a, b), Koelmeyer (1982), 
Dorion (1983), Iten (1987), Shahromet al. (1996) 


Landmark matching 


Bastiaan et al. (1986), Iten (1987), Mackenna (1988), 
Shahromet al. (1996) 


Morphological matching 


Austin-Smith and Maples (1994), Austin (1999), 
Fenton et al. (2008), Jayaprakash et al. (2001, 2010) 


Decision making 


Fade-in/fade-out and sweep 


Video mixing unit device 


Helmer and Grüner (1977a, b), Koelmeyer (1982), 
Bastiaan et al. (1986) 

Helmer and Grüner (19772, b), Bastiaan et al. (1986), 
Iten (1987), Austin-Smith and Maples (1994), 
Shahromet al. (1996), Austin (1999), Solla and İşcan 
(2001), Jayaprakash et al. (2001, 2010) 


Special effects generator 


Mackenna (1988), Sekharan (1988, 1993) 
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Fig. 4.1 Case examples. On the left, the Ruxton case photograph showing the tiara used as a 
measurable reference object (Grüner 1993). In the center, a snapshot of deceased Michael 
Wolkersdorfer in which the tie was used as a scale (the image was taken from Gordon and Drennan 
(1948). On the right, a superimposition of transparencies and tracing of skull Z6 with photograph of 
victim 3 giving a possible elimination (the image was taken from McKenna et al. (1984) 


of the linear pattern of a tie (Gordon and Drennan 1948), the pattern on the border of 
a sari (Sekharan 1971), and the diameter of a button on a sweater (Janssens et al. 
1978) have yielded successful superimpositions and positive identifications. Mea- 
surements of a wooden chair present in a photographic portrait also yielded a 
magnification factor from which an accurate enlargement was made (Sekharan 
1971). In the absence of objects of known size in ante-mortem photographs, several 
workers have combined the use of anatomical landmarks and anthropometric mea- 
surements of the facial skeleton with so-called established values for thicknesses of 
soft tissues to estimate a magnification factor and, thus, obtain a superimposition by 
best fit. Among anthropometric measurements, the most common references were 
the interpupillary distance (Simpson 1943; Reddy 1973; Sekharan 1971) and the 
features of the anterior dentition (McKenna et al. 1984; Sognnaes 1980). 

Figure 4.1(right) shows an example of the latter reference feature. The use of 
landmarks became more important at the end of the century. 

Once the photographs have been selected/obtained and any measurable refer- 
ences have been marked, there are still some tasks to be developed in order to 
facilitate the SFO stage, for example, trace drawings of the head outline have been 
quite helpful in many of the solved cases. Pearson and Morant (1934) took a 
photograph of an Egyptian criminal before his execution to be compared with the 
skull subsequently prepared after his death. The authors made tracings of the face 
and skull photographs so that they could superimpose them. This work is considered 
as the first superimposition using a photograph of the skull and tracings of the face. 
Glaister and Brash (1937) used a full-size transparent portrait outline on the viewing 
screen of the camera. They transferred the head outline of both the face and skull 
photographs to tracing paper. Gordon and Drennan (1948), Cocks (1971), and 
Reddy (1973) also made use of tracings before performing SFO. In this way, 
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Scully and Nambiar (2002) identified a number of factors, which, in their opinion, 
directly influenced a positive superimposition. He said that the selection of a good 
quality ante-mortem photograph is of primary importance to get the most reliable 
result. Poor quality images can result in poor definition, because the ante-mortem 
photograph usually has to be enlarged, making the determination of certain features 
difficult. The expert must choose photographs in which the face under study appears 
as near as possible to the center of the picture. Use of the outer extremities of the 
frame should be avoided due to barrel or pin cushion distortion, as the proportions of 
the face will be considerably distorted. Therefore, the author advised that the face 
should be in good focus, well lit, and not in partial shadow. Scully and Nambiar 
(2002) advised that the exact photographic conditions under which the ante-mortem 
photograph was taken should be discovered: the distance at which it was taken, the 
focal length of the lens used to record the image, even the settings used on the 
darkroom enlarger to produce the final print may be of value. The surface to which 
the ante-mortem photograph is attached should also be exactly parallel to the image 
plane of the camera. The author affirmed that if these factors are unknown, the final 
result is negatively affected. 


4.2.2 Skull-Face Overlay 


There is no common procedure used to carry out SFO and each author tries to do this 
depending on the equipment they have and their knowledge of the technique. 
Identification through photographic superimposition usually shares the following 
two steps: (1) determination of the correct life-size; (2) replication of the same 
orientation of the face in the photograph when photographing the skull. To perform 
these tasks, a diverse set of elements (X-ray, negative and positive photographs, 
outlines, and transparencies), apparatus (light stand, optical bench), and methodol- 
ogies (measurable objects, distance between landmarks or anthropometric measures, 
triangulation based on the landmarks and transparencies, asymmetrical features of 
the facial skeleton) are employed (a summary is presented in Table 4.2). 

Glaister and Brash (1937), while addressing the Ruxton Case, adjusted the skull 
orientation to a similar head position as the one the face showed in a portrait. They 
used tracings of the head outline in both the face and skull photographs and then 
superimposed them. The tracing paper with the superimposed outlines was posi- 
tioned onto the positive print photograph and the paper skull negative. The trans- 
parency was then superimposed using different landmarks (prosthion and nasion)and 
the headoutlines.The positive portrait and the negative skull print were photographed 
again on x-ray. À positive skull portrait and a negative face portrait, each one with 
the registration marks photographed, were obtained as a result. Finally, two trans- 
parencies were superimposed using the central marks and were photographed again 
on the x-ray film. This methodology was the basis for later modification by numer- 
ous authors. 
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Fig. 4.2 From left to right: (a) enlargement of the deceased's face and head (actual size); (b) the 
skull positioned to correspond with the points marked on the camera; (c) final result of the 
superimposition of the first two images (the image was taken from Webster 1955) 


Simpson (1943) executed a superimposition with an x-ray portrait. The width was 
standardized between the eye sockets and the full portrait was then superimposed 
onto the x-ray skull photograph. 

The first step in the Wolkersdorfer case, Gordon and Drennan (1948), was to 
obtain the skull and face images in life-size. They used the natural tie size as a scale. 
The head outline was drawn and a machine was used to superimpose the skull 
drawing over the life-size head drawing. This superimposition showed a good 
anatomical correspondence. 

In Webster (1955), the author obtained a 12” x 10” photograph of 90 people, 
within which the victim was present. The equipment was composed of a Ross half- 
plate camera equipped with a 5-in. Xpres f.4 wide angle lens. They created the 
deceased's face negative from the photograph, which was enlarged approximately 
eight times the size of the original picture. The skull was then oriented in the same 
position as the face. The negative was placed on the ground glass? and three points 
(center of nasal bone, extreme prominence of the left malar bone, and the inner end 
of the left supra-orbital ridge) were marked to obtain the correct alignment of the two 
images (see Fig. 4.2). 

Gruner and Reinhard (1959) designed a light stand and an optical bench for 
positioning the skull and adjusting the photographic angle, with the aim of making 
an accurate superimposition, taking the soft tissue thickness into consideration. They 
stipulated that the correct distance between skull and camera was 1.75 m. The author 


?Ground glass is a glass whose surface has been ground to produce a flat but rough (matte) finish. In 
photography, a sheet of ground glass is used for manual focusing in some still and motion picture 
cameras. The ground-glass viewer is inserted in the back of the camera, and the lens opened to its 
widest aperture. This projects the scene onto the ground glass upside down. 
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took a negative of the skull, which was then enlarged. Finally, he printed it as a 
single image to be used in the overlay. 

Cooks (1971) 's methodology takes a photograph of the skull and compares it 
with a passport picture of the suspected victim. To obtain a good correspondence 
between the skull and the portrait, the author developed a system of triangulation 
based on landmarks (nasion, anterior nasal spine, gnathion, orbit points, and man- 
dible) marked in both images. The triangle patterns were drawn onto the transpar- 
ency looking for correspondence between the superimposed images. 

In Reddy’s method (Reddy 1973), the outlines of the salient features of the face 
are drawn onto the ground glass and the skull is then positioned equally to the face in 
the portrait thanks to a skull-rest. Those outlines are then matched with the skull, 
making allowance for the soft tissue covering the bone. 

Furue’s method (Klonaris and Furue 1980) represented a breakthrough in cra- 
niofacial photographic superimposition. In this study, the authors give importance to 
photographic perspective. They developed a system taking into account the distance 
between camera and subject, and they try to replicate conditions similar to those of 
the ante-mortem photograph. In the first step, the skull was positioned on an 
adjustable stand in front of a backdrop sheet of contrasting colored cardboard at 
one end of a bench and a 30-cm grid of 9 mm was positioned in front of skull. A 
single lens reflex camera was set at the opposite end of the bench and, on the other 
side, a life-size enlargement of the ante-mortem photograph was positioned behind a 
grid of 10 mm?. Two mirrors were placed such that the full mirror reflected the image 
of the photograph upon the half-silvered mirror along the central axis of the camera. 
Two lamps were positioned between the skull and the camera. The images reflected 
in both mirrors were transmitted to the cameras, and the images of both the skull and 
the portrait could be seen through the camera viewfinder. The skull is aligned taking 
into account the perspective incorporated in the ante-mortem image, and the skull 
image was recorded on the camera film following removal of the half mirror. Finally, 
they obtained a victim image negative print and skull positive print, which were 
superimposed. 

Meanwhile, Dorion (1983) used a Graflex camera 4 x 5 with a 135 mm lens 
atf-4.5, and a pivoting head that permitted placement of the skull in the same 
orientation as the photographic transparency. Both are positioned in front of the 
camera at a distance of 95.25 cm. A beam splitter was used for varying the intensity 
of the mounted quartz lights in front of the skull to get a superimposed image 
viewing through the camera. He made a correct image magnification considering 
factors such as the distance of the subject from the camera, which was 95 cm with the 
lens. Then, he enlarged the photograph to a 1:1 ratio using reference landmarks on 
the skull. 

McKenna et al. (1984) selected a photograph in which the maxillary anterior teeth 
are shown. He used a “phantom-head” device that permits skull movements in 
different planes. The negative of the photograph was enlarged until the dentition 
coincided with the dentition of the skull image. Skull features and facial contours 
traced in the negative portrait were superimposed on a radiographic viewing box. A 
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similar methodology was used by Brocklebank and Holmgren (1989) who devel- 
oped new equipment with minor advantages. 

Maat (1989) explained that an optimal result is possible if the distance between 
camera and the skull is the same as the distance from which the original photograph 
was taken; however, this is difficult to achieve. Some authors have established that 
portraits are taken at a safe distance, if they are taken at a distance of 1.5 m or more 
(Gruner and Reinhard 1959). On the basis of the above, Maat enlarged a skull image 
taking into account that all visible landmarks of the superimposed image must cover, 
in the best possible way, their equivalent points on the original portrait. In particular, 
he used a geometrical method to calculate projections of anthropometric distances, 
angles of rotation, and inclination to define the posture of the head or skull with 
respect to the anatomical frontal plane. He proposed to use a set of anthropometrical 
landmarks, along with relative reference lines, to calculate the three components of 
head rotation (“bending forward,” “turning sideways,” and “rolling sideways”) to 
position the skull. The principle of central projection and a minimum photographic 
distance of 1.5 m are important preconditions. 

Lan (1990) used the distance between ectoconchions to determine the natural 
head size in the photograph. He had considered differences in the deflection angle 
with a mechanism that examined eight lines capable of determining the image 
proportions. In contrast, in some other cases, asymmetrical features of the facial 
skeleton (Prinsloo 1953; Sivaram and Wadhera 1975) or the presence of a supernu- 
merary anterior tooth (mesiodens) (Asananer 1972) has facilitated identification by 
superimposition. 

Scully and Nambiar (2002) determined the validity of Furue’s methodology. 
They photographed the skull following similar conditions to those indicated by 
Furue. Despite Scully et al. using digital images, the result was similar to the 
conventional direct photography print used in Furue’s methodology. 


4.2.3 Decision Making 


This phase consists of the systematic evaluation of the correspondence of morpho- 
logical features between the face and skull. However, most authors have described 
anatomical landmarks and anthropometric measurements, which, in their opinion, 
were more significant than others in the determination of a positive identification. 

Before the use of photographic superimposition in the identification of victims, 
several attempts were made to fit tracings or photographs of skulls to painted or 
photographic portraits of famous or infamous people from history (Glaister and 
Brash 1937; Krogman and İşcan 1986). Lander compared the skull of an individual 
of known age, race, and sex with a photograph of the individual, but concluded that 
“Tt seems improbable that any one examining the skull would postulate a type of face 
similar to that seen in the photograph”(Prinsloo 1953). 

Some years later, the superimposition of a photograph of the skull and tracings of 
the face, achieved by Pearson and Morant (1934), were considered to be satisfactory. 
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However, they recognized that such a positive result would not be possible when 
comparing a skull with an artist’s portrait. 

In the Wolkersdorfer Case (Gordon and Drennan 1948), the identity of the victim 
was established by overlapping a drawing of the available parts of the face with the 
outline of the head obtaining a positive anatomical correspondence. In the Plumbago 
Pit Case (Webster 1955), the correspondence between the skull and portrait was 
positive, and the following points were establishing as being significant in deter- 
mining the final result from the superimposition: (1) the length of the skull as 
measured from the nose to the chin; (2) the length of the skull from the top of the 
skull to the chin or nose; (3) the margin of the eye-sockets; (4) the width of the 
temple (bi-temporal width); (5) the width of the face as measured from one cheek 
bone to the other; (6) the position of the mastoid processes; (7) the position of the 
midpoint of the upper jaw between the sockets for the central incisor teeth, and its 
relation to the nose; (8) the position of the teeth in the upper jaw on the left side; and 
(9) the position of the angle of the jaws. 

Reddy (1973) overlapped the negative of a photograph and skull by aligning the 
following characteristic points: the eyes within the two pairs of orbital plates, the 
nasion, the prosthion, the nasal spine in the center, which is a little above the tip of 
the nose, the lower border of the nose, the lower border of the upper jaw, and the 
zygomas below the eyes. The expert observed from the superimposed image that all 
these points properly matched, making it possible to establish the identity of the 
victim. He considered that superimposition may provide significant evidence in 
Court, affirming that it could solve medico-legal problems, such as the identification 
of an individual from the skull. 

Dorion (1983) obtained a positive identification in two cases, comparing soft 
tissue outlines to bone and dental characteristics, although he considered that 
photographic superimposition does not serve as the only basis for a positive identi- 
fication and it should be corroborated by other identification methods or circum- 
stantial evidence. 

McKenna et al. (1984) drew clearly defined features of the skull on matte acetate, 
from the transparency of the skull. The facial contours were traced from the 
transparency of the enlarged snapshot. The transparencies and tracings were 
superimposed, and the correspondence between dental landmarks of the skull and 
face were verified. The photographic superimpositions and composite tracings were 
presented in court and were accepted as a positive identification. Finally, the author 
indicated that photographic superimposition could be established not only as a 
complementary method of identification, but as a means of a positive identification 
in its own right. 

Maat (1989) determined that only a limited number of cephalometric landmarks 
of the head lie close to the craniometric landmarks of the skull, such as nasion- 
nasion, subnasale-nasospinale, gnathion-gnathion, gonion-gonion, a point on the 
lower border of the eyebrow-orbitale superius, and tragion-porion. He suggested 
that, taking individual variability into consideration, it is very unlikely that someone 
else other than the victim reflects all those features. 
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Scully and Nambiar (2002) consider that photographic superimposition can be 
used as the only means of confirming the identity of an unknown skull, using the 
craniometric and somatometric landmarks, racial features, soft-tissue thickness, 
scars, or injuries as a basis. They affirmed that knowledge of craniofacial anatomy 
is a crucial factor for establishing the identity of the victim. 

Krogman and İşcan (1986) recommended the use of photographic CFS whenever 
possible, arguing that it can provide important corroborative and possibly conclusive 
evidence for identification. 
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The common components of almost all video superimposition systems include two 
video cameras, an electronic mixing device, and a TV monitor. Instead of making 
photographs, tracings, or drawings in order to properly superimpose the skull and the 
face, the video cameras provide focused “live images” of the objects (skull and 
photograph). These systems present a great advantage over the former photographic 
superimposition procedures by minimizing several problems associated with the 
photographic systems. For example, the number of manual manipulations and the 
length of the time required in superimposition are dramatically decreased since an 
expert can control the matching of two different images on the TV monitor. 
Nevertheless, the processes of skull orientation and sizing of the ante-mortem 
photograph and the skull in video superimposition remain troublesome. The face 
enhancement and skull modeling stage in this modality is very similar to the one in 
the photographic superimposition technique. For example, Lan and Cai (1985) 
advocated the use of the same orientation procedure employed in photographic 
superimposition. 

In this section, we will review the existing contributions of video CFS systems. 
They will be classified according to the stage of the process, which is addressed 
using a video system. Information about the method used for the remaining stages 
will be given shortly, along with a brief discussion. Unfortunately, in some of the 
existing video superimposition methods, these stages are not as clearly distinguished 
as we might expect. This fact can cause some confusion, as sometimes the authors 
themselves define their own method as photo, video, or computer-aided CFS when 
they are actually referring to one or part of one of the three general stages of CFS. In 
order to be consistent throughout this document, we decided to limit this section to 
the methods in which a video system is the core apparatus of the superimposition 
method and there is no use of computers. There are a set of methods (Lan and Cai 
1985, 1993; Yoshino et al. 1997) that use video cameras to acquire images of the 
skull and the face photograph but also make use of computers to perform important 
tasks within the whole process. Thus, these “hybrid” methods will be reviewed in 
Sect. 4.4. 

As in photographic superimposition, Table 4.2 presents a review of the papers 
describing video superimposition according to the different stages. 
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In the following subsections, the different video CFS approaches and their 
contribution to each of the CFS stages are reviewed. 


4.3.1 Face Enhancement and Skull Modeling 


As in photographic superimposition, in this stage, the first steps are intended to select 
and/or obtain clear and measurable images. Therefore, a photograph, which is 
overexposed or underexposed, blurry, or noisy, will result in a low-quality super- 
imposition (Nickerson et al. 1991). The objectives of image enhancement for video 
superimposition can be enumerated as follows: obtain measurable images; know the 
object-subject distance; select the correct ante-mortem photographs; choose the 
photograph nearest to the moment of disappearance; avoid photographs that show 
chiaroscuro; know all technical data of the equipment; and filter the image to 
produce as much useful image information as possible. In order to obtain measurable 
images, most of the authors used anatomical landmarks and anthropometrical mea- 
surements of the skull and the face. The procedure to mark them varies among 
authors. Some authors, such as Dorion (1983), placed the landmarks on the trans- 
parency using movable white cardboard, which blocks out the skull’s characteristic 
for the same region. Others, for example Bastiaan et al. (1986), located anatomical 
landmarks on the skull by placing a white pointer in or around an area so that each 
point can be accurately viewed. Similarly, Fenton et al. (2008) placed tissue depth 
markers on the skull. 

The knowledge of all the technical data of the equipment used is shown to be 
helpful for the superimposition process. All components can affect the final quality 
of the results achieved. For example, Brow (1983) replaced the video cameras by 
semiprofessional Ikegami cameras, considerably increasing the quality of the image. 

Iten (1987) said that the first step in superimposition is to determine the correct 
height and location of the camera. This must coincide with the photographs that the 
skull is going to be compared with and is defined by a number of variable parameters 
such as the distance between the camera and object, camera height, and orientation 
of the skull. 

Austin (1999) stated that the quality of the photographs is essential. He received 
mug shots, driver's licenses, and family photos to make an identification. Driver's 
license photographs are usually full face and benefit from the enlargement capabil- 
ities of the equipment. However, mug shots and family photographs often represent 
varying angles to the camera film plane. The author suggests using at least two 
photographs with an attempted difference of 90? between them. He recommends 
avoiding images with obstructing factors (facial hair, long hair, hats, etc.). The facial 
photographs must show useful morphological characteristics of the person to be 
identified. Finally, he examined all photographs with a stereomicroscope to ascertain 
the amount of grain, clarity of features, and shadow details. 
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The next step consists of the comparison of both images. Skull orientation can be 
performed in the same manner as in photographic superimposition; however, the 
correct size of the skull is easier to achieve by adjusting the size of the skull using the 
zoom mechanism of the video camera (Yoshino 2012).The method of skull orien- 
tation has varied with the incorporation of new tools, apparatus, and mechanisms 
(see Table 4.2): Helmer and Grüner (19772) were probably the first researchers to 
introduce the video superimposition technique. They substituted a photographic 
camera with a video camera in the CFS procedure. The equipment consisted of 
two video cameras, an electronic mixing unit, and two TV monitors. This allows for 
recording and displaying the skull and the face portrait at the same time. In addition, 
it also offers the possibility of mixing both images, thanks to the mixing unit. 
Consequently, this approach significantly reduced the time needed to enlarge the 
ante-mortem photograph and the skull to the same size. It also presented an out- 
standing mechanism to help in the proper orientation of the skull. Both were the most 
time-consuming tasks in the previous photographic-based approaches. 

Koelmeyer (1982) used three video cameras to reproduce the facial images, the 
skull x-ray, and the partially reassembled skull to perform the superimposition 
between the images. In addition, he made use of the sweep fade-in/out mechanism 
to help guide the superimposition of the skull portrait and face photograph on both 
vertical and horizontal axes. 

Dorion (1983) replaced a Graflex camera with a video camera. He placed it at a 
distance of 92.25 cm from the zygomatic process? of the skull and a face transpar- 
ency was put in front of the skull. Similarly, Chee and Cheng (1989) used a 
transparency of the face photograph positioned in front of the skull and recorded 
both images on the monitor. The face photograph was enlarged to natural size and 
photocopied onto the transparency. 

Bastiaan et al.'s (1986) system incorporated an adjustable support to mount the 
skull. This allowed movement in three planes. Two video cameras (Hitachi GP-5 
colour) were aligned with the ante-mortem portrait and the skull, respectively. Both 
cameras must be compatible with “Gen-Lock” (which consists of the ability of two 
video cameras to synchronize together in order to use the facility of video or vision 
mixing) to obtain synchronized vision mixing. The skull is oriented in the same 
angulation as the head of the subject in the ante-mortem portrait. They proposed to 
enlarge the ante-mortem photograph until the teeth in the superimposed video 
picture overlap. If the teeth are not visible in the face, an estimation of the enlarge- 
ment factor must be employed. Finally, both photographs were superimposed taking 
into account different anatomical landmarks (the external auditory meatus, orbits, 
anterior nasal spine, chin point, angles of the mandible, and zygomatic processes). 


>The zygomatic process is a protrusion from the rest of the skull, like the bumper of a car. Most of it 
belongs to the zygomatic bone, but there are other bones contributing to it too, namely, the frontal 
bone, maxilla, and temporal bone. 
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These points were highlighted on the skull by placing a white pointer in or around 
the relevant area so that each point could be accurately viewed. A video mixing unit 
allowed a fade-in/out of both images in the vertical or horizontal plane. 

The equipment employed by Iten (1987) consisted of two video tubes: an 
electronic mixer unit and three monitors. The skull is recorded with video tubel 
and reproduced on monitor 1. Then, the photograph is recorded with video tube 
2 and reproduced on monitor 2. Both images are mixed on monitor 3, to be appraised 
and recorded. Then, the zoom mechanism of the video camera is used to adjust the 
skull image to facial image size on the monitor, using soft-tissue thickness as 
reference points. Finally, the exact orientation of the skull image is accomplished 
by adjusting the outlines and anatomical landmarks between face and skull images. 
For this purpose, Iten used the ratio of the distance between the eyes and the distance 
between the eye and auditory canal as axes. 

McKenna et al. (1984) used two video cameras and two monitors to record 
images of the skull and the ante-mortem photograph, respectively. They presented 
a method that aligned the skull through a distinctive anatomical point (e.g., the line 
between the central incisor teeth at their incisal tips) and clamped it into position. A 
video camera is focused through a transparent lens cap sight on this reference point 
and is secured in position. Then, it projects the image of the skull onto a television 
monitoring screen. A second video camera, focused on the ante-mortem photograph, 
also projects the corresponding image to the monitor screen. Finally, they made the 
superimposition using a special effects generator, which allowed the mixing of both 
images. 

Brocklebank and Holmgren (1989) developed novel equipment consisting of a 
skull-holding jig and a “pan-and-tilt” device to position the skull by virtue of 
specifically calibrated scales and markings provided on the apparatus. A camera 
was positioned on an adjustable mount running on twin parallel rails, allowing the 
camera distance to be varied. The equipment allowed the correct replication of the 
skull position with the face in the photograph. Finally, the face and skull photo- 
graphs could be evaluated to determine whether it was a positive or negative 
superimposition. 

Sekharan (1993) determined antero-posterior tilt with a mechanical device, but 
she added two parallel wires which show the distance and the different landmark 
planes. She suggested using the vertical distance “d” between the ectocanthions and 
tragion as a measure for calculating the extent of flexion or extension of the head. 
The extent of the rotation of the face was calculated from the L/R ratio, where L and 
R denote the distances between the left and right ectocanthion from the midline of 
the face. Using these factors, the skull under examination was positioned on a tripod 
stand with the help of a remote control positioning device (Kumari and Chandra 
Sekharan 1992). 

Shahrom et al. (1996) presented a method to superimpose a skull and a facial 
photograph, which was very similar to previous approaches. In order to determine 
the position of the skull, the facial photograph was rotated in the coronal plane to 
match the skull angulation. Manipulation of the skull position or angulation using 
the skull holder was only conducted in two planes (sagittal and horizontal). Then, 
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two different video cameras captured the facial photograph and the skull. The video 
images were mixed into one on the television monitor, and then, the expert deter- 
mined the relationship between landmarks on the skull and the face. 

Iten (1987) developed three different methods of video superimposition for 
forensic case work: skull/photograph superimposition, radiographic comparison, 
and photograph/photograph superimposition. These procedures usually involve a 
still photograph of the skull, which is overlaid with the facial photograph, two video 
cameras, and a mixing device to superimpose the two images. The video superim- 
position set-up proved useful for ante-mortem and post-mortem radiograph compar- 
isons. He used the video superimposition equipment to compare scene photographs 
with known photographs of a suspect. In Austin-Smith and Maples (1994), the 
superimposition process was presented as follows: A photograph was placed under 
one of the cameras and the face was focused so that it filled the monitor screen as 
fully as possible. Tissue thickness markers were positioned on the skull at the 
appropriate anatomical landmarks. The tissue thicknesses used were determined by 
ultrasound on living subjects and ranged from thin to obese individuals. The position 
of the head in the photograph was scrutinized, and the skull was placed on a cork ring 
to estimate that position. The distance between a horizontal projection from the 
lateral angle of the eye and another from the external auditory meatus was approx- 
imated. The skull was put under the second video camera, the size was adjusted so 
that the tissue thickness markers fell within the outline of the face, and the pro- 
portions of the anatomical features were maintained. Exact positioning was deter- 
mined by trial and error manipulation of the skull. 

Solla and İşcan (2001) modified the previous system. In this case, the facial image 
was reproduced and digitized in the video mixing unit. A plastic sheet with different 
landmarks traced was taped to the monitor. The orientation of the skull was adjusted 
based on these landmarks, taking soft tissue into account, and manipulated manually 
to get the same position as the face in the portrait. Then, they used a video camera 
zoom to adjust the size of both images. Both images were then reproduced on a TV 
monitor for detail comparison. The authors describe the video mixing unit as a 
device that allows any desired combination of photo-skull comparison, including 
removing the soft tissue to view the underlying skeletal structures such as the 
auditory canal, eye sockets, cheekbones, jaw bones, root of nose, teeth, chin, skull 
contours, and so forth. 

Fenton et al. (2008) employed two video cameras, a video cassette recorder, a 
video mixer, TV monitor, and software similar to that recommended by Austin- 
Smith and Maples (1994). Their video superimposition process began by placing 
appropriate tissue depth markers on the skulls. Once this was completed, the 
“dynamic orientation process” was used to arrive at the best fit possible in the 
alignment of the skull with the ante-mortem photo. 

The dynamic orientation process involves positioning of the ante-mortem photo- 
graph under one of the two video cameras so that the image fills most of the TV 
monitor. Next, the skull is placed under the other camera. Using the mixer and 
monitor, the skull image is sized so that it can be superimposed onto the image of the 
face. Once the skull and ante-mortem photo are satisfactorily adjusted for size and 
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basic orientation, the craniofacial proportions of the skull and the face can be 
evaluated and compared. This is accomplished by manually adjusting the skull so 
that the key skeletal landmarks align with corresponding landmarks on the face. The 
set of landmarks employed for this purpose are: porion, right and left Whitnall's 
tubercles (to be aligned with right and left ectocanthion points of the face), subnasal 
points, and gnathion. 

In conclusion, the general procedure of video superimposition presents important 
similarities among the different approaches; however, the techniques or methodol- 
ogies have varied with the development and incorporation of new tools, apparatus, 
and mechanisms, which have reduced the problems of the orientation and size of the 
skull with respect to the facial photograph. 


4.3.3 Decision Making 


Once SFO is fulfilled, the decision-making process is carried out. The main tools 
involved in the decision-making stage include fade-in/out, video mixing, or special 
effect generators (see Table 4.2). Nevertheless, the experience of the forensic 
anthropologist continues to be of paramount importance in the determination of 
identity. 

Koelmeyer (1982) used three video cameras to reproduce the skull, the facial 
photographs, and a radiograph. Then, the use of a switcher joystick to fade-out, fade- 
in, and sweep allows a progressive superimposition of the radiograph, and the skull 
image on the facial photograph, on both vertical and horizontal axes. As a result, the 
system creates a more pleasing image and makes a better comparison of bony 
landmarks possible. 

Bastiaan et al. (1986) considered different anatomical landmarks for the decision 
stage: the external auditory meatus, orbits, anterior nasal spine, chin point, angles of 
the mandible, and zygomatic processes. 

Helmer and Grüner (1977a)'s system allows the division of the superimposed 
image into various sections that show either the skull or the face. It also provides 
control over the transparency of both the skull and face images on the TV monitor. 
Both have resulted in being very helpful for the overall assessment of the anatomical 
correspondence between the skull and the face. Many authors employ this video 
equipment with similar configurations and procedures. In particular, Sekharan has 
carried out positive identifications in 140 cases since 1985 using this methodology 
(Sekharan 1988). Half of the skull image and half of the photograph can be displayed 
simultaneously using a special effects generator. Sekharan assured that observation, 
comparison time, and judgment error could be reduced by a significant rate. 

Iten (1987) indicated that one can begin comparing the facial image with that of 
the skull, once the enlargement and orientation procedures are complete. The 
comparison is carried out on a monitor that allows the user to mix and produce 
picture sections in order to compare all anatomical landmarks and morphological 
features such as the auditory canal, eyes socket, cheekbones, jawbone, root of the 
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nose, teeth, chin, and skull contour. The same procedure described above was 
performed by Shahrom et al. (1996). 

McKenna (1988) used a special effects generator that enables the size of the 
images of the skull and photographs to be matched by superimposition of the 
respective dentitions. This allows the points to be easily placed. McKenna adds 
that the video camera can be replaced by a photographic camera at the same radial 
distance and the same angular axes. Therefore, overlay transparencies can be 
prepared from the photographic camera negatives for presentation in court, consid- 
ering that it allows a static display of the final result of the overlap without the 
distortion created by the monitor screen. 

Brocklebank and Holmgren (1989) marked the outlines of all relevant features of 
both transparencies on tracing film for an assessment of the degree of anatomical 
consistency. Suitable hard and soft tissue features included the following: all dental 
features; outlines of bone margins and corresponding soft tissue features; interpu- 
pillary line and midorbital line; and the midline of the face and skull. Then, 
superimposition of both transparencies took place in order to assess whether there 
was a positive match or not, and the level of confidence in the resulting 
identification. 

Austin (1999) claimed that the experience of the analyst and the integrity of the 
equipment are very important. He affirmed that it is necessary to know the relation- 
ship of soft tissue with face bones, achieved through the study of known skulls with 
their own photographs. 

Fenton et al. (2008) used the same 12 morphological features, in frontal view, as 
Austin-Smith and Maples (1994), for establishing a consistent fit between the face 
and skull. By evaluating facial proportionality and by comparing morphological 
features of the face and skulls, one skull was excluded as a possible match and one 
skull was not excluded as a match to the ante-mortem photo. 

The most advanced video superimposition systems also make use of computer 
software that allows the user to quantitatively evaluate the adjustment between a 
skull and a facial photograph in two and three dimensions. 


4.4 Computer-Aided Craniofacial Superimposition 


The differentiation between methods that use computer technology and those that do 
not has already been proposed (Aulsebrook et al. 1995). In the literature, photo- 
graphic and video superimpositions have been considered to belong to the former 
category. Meanwhile, methods defined as digital or computer-aided CFS have been 
considered to belong to the latter. Thus, the distinction between computer-aided and 
non-computer-aided methods has been clearly guided by the use of computer-based 
technology within the CFS process up to now. Nevertheless, the role of the computer 
in this process is presently very important and it has not been considered in previous 
reviews. Moreover, the analysis of previous contributions is especially difficult 
when some authors claim they propose a “computer-aided” or “computer-assisted” 
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Table 4.3 Overview of computer-aided photo superimposition systems 


Stage Author 
Face enhancement and skull modeling 
Acquisition of photographs of the skull at dif- | Al-Amad et al. (2006) 
ferent angles 
Acquisition of frontal photographs of the skull | Ghosh and Sinha (2001, 2005) 
Skull face overlay 
Manual scaling with Adobe Photoshop™*“free | Austin-Smith and Maples (1994), Bilge et al. 


transform” tool (2003), Ricci et al. (2006) 

Face and skull visualization at the same time Damas et al. (2011), Bilge et al. (2003), Ghosh 
with Adobe Photoshop™ “Semitransparent” and Sinha (2005), Scully and Nambiar (2002) 
utility 

Automatic overlay using artificial neural Ghosh and Sinha (2001, 2005) 


networks (frontal images only) 


Decision making 


Morphological validation with Adobe Scully and Nambiar (2002), Bilge et al. 

Photoshop™ "Semitransparent" utility (2003), Ricci et al. (2006), Takaé and Pilija 
(2012) 

Automatic calculation of index of similarity Ghosh and Sinha (2001) 


based on distances 


Automatic objective assessment of symmetry Ghosh and Sinha (2001, 2005) 


system (Ricci et al. 2006) yet the computer mainly plays the role of a simple 
visualization tool. 

Whenever a computer is employed as part of the CFS system, the method should 
be considered a computer-aided technique. The following classification better 
reflects the state of the art regarding the use of computers in one or all stages of 
the process and the interaction between various technological approaches: (a) - 
computer-aided craniofacial photo superimposition, (b) computer-aided craniofacial 
video superimposition, and (c) computer-aided craniofacial 3D-2D superimposition. 

Additionally, the classification should differentiate between nonautomatic and 
automatic methods (Damas et al. 2011). Computer-aided nonautomatic methods use 
some kind of digital infrastructure to support the CFS process, that is, computers are 
used for storing and/or visualizing the data. However, they are characterized by the 
fact that their computational capacity to automate human tasks is not considered. On 
the other hand, computer-aided automatic methods use computer programs to 
accomplish an identification subtask itself. 

Tables 4.3, 4.4, and 4.5 give an overview of the papers describing computer-aided 
systems, classified into the three categories already detailed. Studies are listed in 
chronological order. Additional information about the degree of automation and the 
input data required is provided where available. 

There are some remarks that should be pointed out concerning the three stages of 
the process: 


° Regarding the first stage, automatic methods may deal with either the 2D image of 
the face or the skull. On the one hand, when dealing with the 2D image of the 
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Table 4.4 Overview of computer-aided video superimposition systems 


Stage 


Face enhancement and skull modeling 


Author 


Manual anatomical landmark location on a 
plastic slide taped onto the monitor 


Ubelaker et al. (1992) 


Manual landmark location using specific 
software 


Ricci et al. (2006), Takaé and Pilija (2012), 
Ghosh and Sinha (2001), Pesce Delfino et al. 
(1986, 1993), Yoshino et al. (1995), Lan and 
Cai (1988, 1993) 


Manual contouring using specific software 


Pesce Delfino et al. (1986, 1993), Yoshino et al. 
(1995) 


Automatic contrast enhancement, equalization, 
and filtering using specific software 


Pesce Delfino et al. (1986, 1993) 


Manual tissue marker location on the real skull 


Pesce Delfino et al. (1986) 


X-ray acquisition in seven pitch angles and ten 
reflection angles (research method for living 
individuals) 


Pesce Delfino et al. (1993) 


Skull face overlay 


Manual manipulation of the skull for replica- 
tion and orientation using landmarks 


Yoshino et al. (1995), Lan and Cai (1988), 
Pesce Delfino et al. (1986, 1993), Ubelaker 
et al. (1992) 


Manual skull replication and orientation using 
anthropometric measurements 


Lan and Cai (1985, 1988, 1993) 


Face and skull visualization at the same time 
using specific software 


Lan and Cai (1993), Yoshino et al. (1995), 
Ubelaker et al. (1992) 


Manual skull replication and orientation using 
a pulse motor-driven mechanism, fade-out, and 
wipe mode 


Yoshino et al. (1995), Lan and Cai (1988) 


Decision making 


Manual assessment using soft tissue markers 
Fade-in and fade-out 


Lan and Cai (1993) 
Yoshino et al. (1995), Ubelaker et al. (1992) 


Semiautomatic landmark distance 
measurement 


Yoshino et al. (1995, 1997), Birngruber et al. 
(2010) 


Semiautomatic measurement of 
anthropometrical indexes using specific 
software 


Yoshino et al. (1995), Lan and Cai (1988), 
Ubelaker et al. (1992) 


Automatic assessment of skull and face out- 
lines using specific software 


Yoshino et al. (1995, 1997), Pesce Delfino et al. 
(1986, 1993) 


face, automatic systems accomplish the restoration of the photograph by means of 
digital image-processing techniques. On the other hand, the aim of automatic 
methods concerning the skull is the achievement of an accurate 3D model. 

* Concerning the second stage, Damas et al. (2011) pointed out a clear division 
between computer-aided nonautomatic and automatic SFO methods. The former 
use computers to support the overlay procedure and/or to visualize the skull, the 
face, and the obtained superimposition. Nevertheless, the size and orientation of 
the skull are changed manually to correctly match that of the head in the 
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Table 4.5 Overview of computer-aided 3D-2D approaches 


Stage 


Face enhancement and skull modeling 


Author 


Manual alignment of skull range images 


Shahrom et al. (1996), Lan and Cai (1993), 
Yoshino et al. (1995) 


Automatic alignment of skull range images 


Santamaria et al. (2007a), Pesce Delfino et al. 
(1986, 1993) 


Automatic and faster alignment of skull range 
images 


Shahrom et al. (1996), Fantini et al. (2008) 


Holography for 3D recording of forensic 
objects 


Biwasaka et al. (2005) 


Computed tomography vs. laser range scanner 


Benazzi et al. (2009) 


Fuzzy location of cephalometric landmarks 


Santamaria et al. (2007a), Ibáñez et al. (2009a, 
2011), Ballerini et al. (2009) 


Skull face overlay 


Automatic overlay by matching pairs of land- 
marks and genetic algorithms 


Nickerson et al. (1991), Galantucci et al. 
(2006), Ibáñez et al. (2009a) 


photograph. This is achieved by either physically moving the skull, while com- 
puters are simply used to visualize it on the monitor, or (with the help of some 
commercial software) by moving its digital image on the screen until a good 
match is found. The automatic SFO methods find the optimal superimposition 
between the 3D model of the skull and the 2D image of the face using computer 


programs. 


* Finally, regarding the decision-making stage, automatic systems assist the foren- 
sic expert by applying decision support systems (Keen and Morton 1978). 
Moreover, these computer programs use objective and numerical data for evalu- 
ating the obtained matching between the skull and the face. Based on that 
evaluation, the system suggests an identification decision to the forensic expert. 
Thus, the decision support system is intended to help decision makers compile 
useful information from the analysis of the SFO outcomes. Of course, the final 
decision will be always made by the anthropologist according to both the support 
of the automatic system and his expertise. On the other hand, if the identification 
decision only relies on the human expert who visually evaluates the superimpo- 
sition obtained in the previous stage, then the method will be considered as a 
nonautomatic system, although it might use digital data as a supporting means. 


4.4.1 Discussion of Existing Works 


In this section, we will review the existing contributions of computer-aided CFS 
systems. They have been classified according to the stage of the CFS process which 
is addressed using a computer-aided method. Information about the methods used 
for the remaining stages will be given together with a brief discussion. 
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Unfortunately, in some of the existing CFS methods, the stages are not as clearly 
distinguished as we might expect. This causes some confusion as sometimes authors 
themselves define their own method as computer-aided CFS when they refer only to 
the decision-making stage and others refer to the identification method when they 
tackle the SFO stage. 


4.4.2 Face Enhancement and Skull Modeling 


Let us highlight the main differences between the image of the face and the model of 
the skull. The face image is typically a photograph that has been acquired under fixed 
conditions that are usually unknown at the time of the forensic analysis. With a 
digital image, the only possibility is to attempt to enhance its quality. If it is not in 
digital format, it can be scanned and transformed into a 2D digital image. Then, it 
can be enhanced using digital image filters and/or processing algorithms. However, 
the skull is an available physical object and a model of it needs to be obtained to 
allow for an automatic procedure. 

We will detail both face enhancement and skull modeling procedures. Regarding 
the image of the face, good quality is needed (Nickerson et al. 1991); therefore, 
enhancement techniques should be applied (Gonzalez and Woods 2008). Such 
techniques depend on the available format (digital camera image or scanned photo- 
graphic paper) and include frequency domain filters to fix artifacts due to aliasing 
and sampling problems present in scanned documents, as well as removal of 
nonuniform illumination effects and sharpening methods to deal with blurring and 
problems related to movement. Notice that the choice of a proper filter and its most 
suitable parameters must be performed by the expert, since they depend strongly on 
the acquisition conditions. As explained above, approaches that use human-operated 
commercial software for the 2D face image enhancement will be considered 
nonautomatic methods. Automatic methods perform such 2D image enhancement 
using computer programs with almost no human intervention. 

Regarding the model of the skull, recent techniques for CFS need an accurate 3D 
model. In the biomedical field computed tomography, scanning images are used as 
the starting data for reconstructing the skull (Singare et al. 2009; Fantini et al. 2008). 
However, the possibility of recording 3D forensic objects is limited, considering the 
available resources of a typical forensic anthropology lab. Indeed, nowadays, many 
forensic labs are exploiting the capabilities of laser range scanners. That is due to the 
fact that these devices present a greater availability and a lower cost. Thus, we will 
consider the possibility of extending the study to other devices that have also been 
used for obtaining a 3D model of the skull in other application domains (Nakasima 
et al. 2005; Enciso et al. 2003). Laser range scanners are based on the optical 
principle of triangulation and acquire a dense set of three-dimensional point data 
in a very rapid, noncontact way (Bernardini and Rushmeier 2002). Some laser range 
scanners are equipped with an additional positioning device, such as a rotary table, 
and appropriate software that permits the 3D reconstruction. Nevertheless, there are 
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situations where the software does not provide suitable 3D models. Moreover, there 
are scenarios where it is not even possible to use a rotary table. 

Before continuing with the 3D modeling process, every 3D view of the skull 
acquired by the laser range scanner must be preprocessed. This task involves the 
cleaning, smoothing, and filling of the view. Cleaning aims to remove those artifacts 
that were acquired by the scanner as part of the scene but which do not correspond to 
the skull. Meanwhile, smoothing is mainly concerned with the removal of any 
artificial vertices that could have been wrongly included by the scanner on the 
borders of the surface because of perspective distortion. Fortunately, this task is 
not needed as often. Finally, filling is used to avoid small holes appearing in the parts 
of the skull that are not properly scanned, because they are too dark for the scanner 
capabilities or because they are located in shadow regions. 

Some anthropologists are skilled enough to deal with the set of 3D views and 
supervise the creation of the 3D model using commercial software like RapidForm 
TM. Sometimes, this software does not provide the expected outcomes and the 
anthropologists have to stitch up every couple of adjacent views manually. Hence, 
3D image reconstruction software is a real requirement in the construction of the 3D 
model, as it allows the views to be aligned in a common coordinate frame. This 
process is usually referred to as range image registration (Brown 1982; Ikeuchi and 
Sato 2001; Zitova and Flusser 2003). It consists of finding the best 3D rigid 
transformation (composed of a rotation and a translation) to align the acquired 
views of the object. An example of three different views of a skull and the 
reconstructed 3D model is shown in Fig. 4.3. 

In this section, we will mainly focus on contributions that include an automatic3D 
modeling procedure, because the other methods do not consider this stage and 
directly acquire a 2D projection of the skull (i.e., a skull photo). As said, all the 
approaches that use computers but do not consider the 3D skull model will be 
considered as nonautomatic methods (Yoshino et al. 1995; Ghosh and Sinha 2001; 
Pesce Delfino et al. 1986; Ricci et al. 2006). 

To our knowledge, Nickerson et al. (1991) were the first researchers to propose 
the use of a 3D model to tackle the CFS problem. In their work, a range scanner and a 
digital camera were used for 3D digitization of the skull surface mesh and the 2D 
ante-mortem facial photograph, respectively. 

Well-known image-processing algorithms were used for image enhancement 
(median filtering, histogram equalization, Wiener filtering) (Gonzalez and Woods 
2008). Rendering was completed through the use of computer graphics techniques. 
A feature-based algorithm to reduce the computational and memory complexities 
inherent in solid modeling was also described. 

Shahrom et al. (1996) followed a similar approach based on the use of a 3D laser 
range scanner. The authors used a skull holder, which could be slowly rotated 
through 360? in a horizontal plane under computer control. The 3D model was 
later used in facial approximation. 

A completely different approach is presented in Biwasaka et al. (2005), in which 
the authors examined the applicability of holography in the 3D recording of forensic 
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3D Model Reconstruction with 


Evolutionary Algorithms 


Fig.4.3 Three different views of a skull and the reconstructed model 


objects. Holography is an optical technique capable of recording the 3D data of an 
object. Two types of images, real and virtual, can be recorded in a holographically 
exposed film or hologram. Two superimposition systems using holographic images 
were examined in order to evaluate the potential use of this recording method. The 
authors claim that the performance of holography is comparable to that of the 
computer graphics system, which consists of an image scanner, software, and a 
display unit. Moreover, they argue that it can even be superior to the computer 
technique with respect to the 3D reconstruction of images. The suitability of this 
technique requires further study. In particular, the use of an automatic superimposi- 
tion method and a comparison with a reconstructed 3D range image could objec- 
tively prove the utility of holography in this field. 

Galantucci et al. (2006) compared two different acquisition techniques of images 
of a skull. In particular, computed tomography and laser range scanners performance 
were compared to ascertain which enabled more accurate reproductions of the 
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original specimen. Comparison between the original and each model yielded satis- 
factory results for both techniques. However, computed tomography scanning dem- 
onstrated some advantages over the laser technique, as it provided a cleaner point 
cloud, enabling shorter preprocessing times, as well as data on the internal parts, 
which resulted in the reproduction of a more faithful model. 

Santamaría et al. (2007a, 2007b, 2009a) proposed a method, based on evolution- 
ary algorithms (Bäck et al. 1997), for the automatic alignment of skull range images. 
Different views of the skull to be modeled were acquired by using a laser range 
scanner. A two-step pair-wise range image registration technique was successfully 
applied to such images. The method includes a prealignment stage that uses a scatter- 
search based algorithm (Laguna and Marti 2003) and a refinement stage based on the 
classical iterative closest point algorithm (Besl and McKay 1992). The method is 
very robust since it reconstructs the 3D model of the skull even if there is no 
turntable and the views are scanned incorrectly. 

Fantini et al. (2008) used a laser range scanner to create a 3D model of a damaged 
medieval skull. The large missing part of the skull allowed scanning of both the outer 
and inner surfaces of the object. Thirty-three partial views were needed to complete 
the acquisition of the whole surface by rotating the skull. Through postprocessing of 
the data collected from the 3D scans, a triangular mesh was finally obtained. The 
operations were performed by RapidForm 2006, RE™ commercial software. 

A similar approach was followed in Benazzi et al. (2009) in order to tackle the 3D 
skull reconstruction of Dante Alighieri (1265-1321) as part of a project to achieve a 
facial approximation of the famous poet. Based on the data provided by a laser range 
scanner, the model of Dante's skull was constructed using the utilities provided by 
the Rapidform XOS2™ commercial software. In particular, authors refer to opera- 
tions such as registration and merging of the point clouds, as well as simplification 
and editing of the digital model. 

Ballerini et al. (2009) presented a feature extraction algorithm, based on evolu- 
tionary computation (Back et al. 1997; Laguna and Martí 2003),to identify a subset 
of points that could improve the registration of multiple views and reconstruct an 
accurate 3D model of skull objects. They extracted a set of relevant features from 
point clouds acquired by a 3D range scanner. They overcame the trade-off between 
having a fully automatic method and using allow number of points located on 
meaningful features. The method detected regions close to boundaries and localized 
small and sharp features. The technique was robust when dealing with nonuniform 
sampled surfaces. 

Ballerini et al. (2009) proposed the automatic reduction of data provided by the 
laser range scanner used in the skull 3D model reconstruction task. The dense point 
cloud corresponding to every skull view is synthesized by considering heuristic 
features that are based on the curvature values of the skull surface. Those features 
guide the automatic 3D skull model reconstruction by means of an evolutionary 
algorithm. 
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The success of the superimposition technique requires the positioning of the skull in 
the same pose as the face. The orientation process is a very challenging and time- 
consuming part of the CFS technique (Fenton et al. 2008). Most of the existing CFS 
methods are guided by a number of landmarks on the skull and the face. Once these 
landmarks are available, the SFO procedure is based on searching for the skull 
orientation leading to the best matching of the set of landmarks. Scientific methods 
for positioning the skull had already been proposed before computers became largely 
available. As reviewed in Sect. 4.2, in some of the very early approaches (Glaister 
and Brash 1937), the enlargement factor is calculated based on linear measurements 
of items within the ante-mortem photograph, such as fabric patterns, buttons, ties, 
and other objects of known geometry (doors, chairs, etc.) (Sekharan 1993). Other 
scale correlation methodology has included measurement of the interpupillary dis- 
tance and the size of the dentition (Austin-Smith and Maples 1994) used a geomet- 
rical method to calculate projections of anthropometric distances, angles of rotation, 
and inclination to define the posture of the head or skull with respect to the 
anatomical frontal plane. None of these methods are computer-aided, but they are 
somehow closer to such strategies than to the trial and error procedures. In these 
approaches, the skull is manually placed on a tripod; however, its pose is estimated 
using a mathematical procedure instead of a trial and error routine. The researchers 
calculated the head size and orientation in the photograph to position the skull in the 
same posture. 

Within the group of computer-aided SFO contributions, we will differentiate 
between nonautomatic and automatic works as follows. 


4.4.3.1 Nonautomatic Skull-Face Overlay Methods 


Below, we describe SFO methods known as computer-aided methods in the litera- 
ture. Nevertheless, following the Damas et al. (2011) proposal, we prefer to refer to 
them as computer-aided nonautomatic SFO methods. They are typical examples of 
the use of a digital infrastructure but without taking advantage of its potential utility 
as an automatic support tool for the forensic anthropologist. Notice that they depend 
on good visualization and overlay mechanisms to aid human operators. Hence, 
processes following this approach are prone to be time-consuming, hard to repro- 
duce, and subjective. 

Lan and Cai (1985) developed a CFS apparatus called TLGA-1, based on the 
principles of dual projection. During the following years, these authors further 
developed this system resulting in new subsequent versions, TLGA-2 and finally 
TLGA-213 (Lan and Cai 1988; Tao 1986; Lan 1990). The TLGA-213 system was 
composed of a TV camera, a computer, an A/D and D/A converter, a mouse, and the 
213 system software library. The system calculated the pitch angle of the photograph 
of the face by measuring the ratio between distances in the vertical line segments 
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glabella to nasion and gnathion to nasion. The natural head size was calculated from 
the distance between the ectocanthions and the deflection angle in the photograph. 
The latter parameters were iteratively computed and considered as a guide for the 
manually performed SFO. 

Ubelaker et al. (1992) solved a huge number of cases submitted to the 
Smithsonian Institute by the FBI. Their software allows any desired combination 
of skeletal-photograph comparisons, including the chance to remove the soft tissue 
to view the underlying skeletal structure. It works on digitized images of both the 
face and skull and offers the possibility to assess the consistency between them. The 
identification procedure usually requires less than 1 h. It is not specified if this time 
includes the acquisition and SFO steps or only the decision-making stage. However, 
for the acquisition of the digital images, the authors visualize the facial photograph 
and trace anatomical landmarks on a plastic slide taped onto the monitor. Then, they 
visualize the skull and manually manipulate it to match the marked landmarks. The 
quality of the photograph and the proper orientation of the skull are claimed to be 
highly influential to the success of the technique. 

The superimposition method of Lan and Cai (1993) is based on the radiographic 
recognition and labeling of landmarks on the face and skull. First, they placed a drop 
of lead on 28 landmarks on the face of the person to be examined. Then, they had the 
subject sit facing the radiographic film box and took X-rays in seven pitch angles and 
ten reflection angles, using the two ectocanthions on the skull as objective points 
with a certain subject-to-film box and X-ray unit-to-film plate distances. After the 
radiographs had been developed, measurements were taken and the distances 
between landmarks on the skull and face were calculated, as well as indices, and 
corrections for radiographic distortion of the measurements were made to make them 
conform to their actual values. From the above test, they obtained projectional plane 
data and index relationships between landmarks in related parts of the skull image 
and soft tissue of the face. They also calculated the displacement formulae and 
projectional data of different superimposed marking points at different angles. 

Yoshino et al.'s skull identification system (Yoshino et al. 1997) consists of two 
main units, namely, a video SFO system and a computer-aided decision-making 
system. In the former, a pulse motor-driven mechanism and a video image-mixing 
device (with fade-out or wipe mode) are used to estimate the orientation and size of 
the skull to reach the pose in the facial photograph. Then, the skull and facial images 
are digitized, stored in the computer, and superimposed on the monitor. 

Ricci et al. (2006) presented an algorithm to compare a facial image with a skull 
radiograph. They worked with pairs of 2D images and the superimposition was 
carried out by the human operator who marked anatomical points and adjusted them 
to match. The algorithm only calculates distances and thresholds in an automatic 
way, while SFO is completed manually. 

The use of commercial software such as Adobe Photoshop™ has been reported 
by Bilge et al. (2003) and Al-Amad et al. (2006). They used the “free transform" tool 
to adjust the scale of the photograph of the face, superimposed over the skull 
photograph. The “semitransparent” utility allows the operator to see both images 
while moving, rotating, and resizing the overlaid image (see Fig. 4.4). 
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Fig. 4.4 Nonautomatic skull-face overlay based on Photoshop™ 


A similar approach was also used by both Scully and Nambiar (2002) and Ricci 
et al. (2006) to validate a classical method and to superimpose skull radiographs, 
respectively. The computer program Adobe Photoshop® 7.0 was also used in Takaé 
and Pilija's (2012) proposal. They reported a case of negative superimposition. 
Photographs of randomly selected young living woman were superimposed onto a 
previously discovered female skull. Digitized photographs of the skull and face were 
superimposed onto each other and displayed on a monitor in order to assess their 
possible similarities or differences. Special attention was paid to matching the same 
anthropometrical points of the skull and face, as well as following their contours. 
The process of fitting the skull and the photograph was usually started by setting the 
eyes in the correct position relative to the orbits. In this case, the gonions were 
positioned beyond the face contour and gnathion was highly placed. In positioning 
the chin, the mouth and nose could not be placed in their correct anatomical position. 
The authors detailed all the difficulties associated with the superimposition and 
recorded the negative superimposition results. The negative superimposition had a 
greater probative value (exclusion of identification) than a positive superimposition 
(possible identification). 

Birngruber et al. (2010) presented a superimposition technique that uses a free 
software tool called Afloat®. The skull is positioned at a distance of 2 m in front of a 
camera and the image is displayed in live view mode on the computer screen. The 
window with the digitized portrait image is then made semitransparent and floated 
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over the live view window showing the skull with the Afloat®(v.2.1) software. In the 
windows, the skull with the tissue markers can then be aligned along the anatomical 
axes to match the orientation of the portrait in the overlying window. The skull is 
then photographed to obtain an aligned skull image for the superimposition 
technique. 


4.4.3.2 Automatic Skull-Face Overlay Methods 


We have found only a small number of really interesting works that perform SFO in 
a fully automatic way. A few of them are based on the use of machine learning 
algorithms (Mitchell 1997) from artificial intelligence, as artificial neural networks 
(Rumelhart and McClelland 1986). However, the majority use multimodal optimi- 
zation methods, that is, evolutionary algorithms (Bäck et al. 1997) and fuzzy logic 
(Zadeh 1965). The automation provided by these approaches represents an added 
value, since they are typically faster than nonautomatic methods. Moreover, they 
rely on quantitative measures and they can be easily reproduced. However, this type 
of work often involves technical concepts that are usually unknown by most forensic 
anthropologists. Thus, a multidisciplinary research team is required. A brief descrip- 
tion of the methods in this group is provided below. 

The method proposed by Ghosh and Sinha (2001) is an adaptation of their 
previous work for face recognition problems (Sinha 1998), and it was recently 
applied to an unusual identification case (Ghosh and Sinha 2005). Their proposed 
Extended Symmetry Perceiving Adaptive Neuronet (ESPAN) consists of two neural 
networks, which are applied to two different parts of the overlaying process. It 
allows the selection of fuzzy facial features to account for ambiguities due to soft 
tissue thickness. The system can also implement an objective assessment of the 
symmetry between two nearly frontal 2D images: the cranial image and the facial 
image, which are input as the source and the target images, respectively. The output 
is the mapped cranial image suitable for superimposition. The two neural networks 
need to be trained separately, because each can correctly map only a part of the 
cranial image. Two limitations are pointed out by the authors: (1) a part of the cranial 
image will not be properly mapped, and (2) a front view image is needed. Moreover, 
this method is not fully applicable for two reasons. Firstly, an important drawback is 
its long computation time and secondly, the need to apply two different networks 
separately is also a relevant flaw. Each network must deal with the upper skull 
contour and the front view cranial features, respectively. The superimposition found 
by the first network can be disrupted by the one achieved by the second network. 

On the other hand, Nickerson et al. (1991) proposed a novel methodology to find 
the optimal fit between a 3D skull model and a 2D digital facial photograph. The 
most important novelty of this technique was the automatic calculation of the 
overlay of the skull surface mesh on the digital facial photograph. This mapping 
was achieved by the matching of four landmarks previously identified in both the 


80 4 Craniofacial Superimposition Techniques 


Fig. 4.5 From left to right, manual and computer-aided CFS 


face and the skull. The landmarks used in their work were: glabellaor nasion, the two 
ectocanthion points, and an upper mandibular dentition point, if present, or the 
subnasal point. The mappings were developed from sets of similarity transforma- 
tions and a perspective projection. The parameters of the transformations and the 
projection that overlay the 3D skull on the 2D photograph are optimized with three 
different methods: heuristic, classic nonlinear optimization, and a binary-coded 
genetic algorithm, with the latter achieving the best results. 

Ballerini et al. (2007) proposed an improvement on Nickerson et al.’s approach. 
The forensic experts extracted different landmarks on the 3D skull model obtained in 
the first stage and on the face photograph. Then, a genetic algorithm was used to find 
the optimal transformation to match them. The main differences between this 
approach and the previous one are the use of a real coding scheme and a better 
design of the genetic algorithm components. The method for the superimposition of 
the 3D skull model on the 2D face photograph is fully automatic. 

Ibáñez et al. (2009a) extended the initial results from Ballerini et al. (2007) to 
accomplish a broader study in order to demonstrate that real-coded evolutionary 
algorithms are suitable approaches for CFS. In particular, the authors highlighted the 
good performance and high robustness of the state-of-the-art covariance matrix 
adaptation evolution strategy (CMA-ES) (Hansen and Ostermeier 2001). Moreover, 
the CMA-ES computation time was less than 15 s in the six real-world identification 
cases considered. It is an impressive improvement with respect to the manual 
superimposition performed by a forensic expert, which took several hours. An 
example of an automatic superimposition achieved by this method is shown in 
Fig. 4.5. A new SFO method based on the scatter search evolutionary algorithm 
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was proposed a few years later by Ibáñez et al. (2012a). It was a new 3D-2D image 
registration optimizer for the SFO task that facilitates the integration of prior 
knowledge. They incorporated a method to properly initialize the algorithm and to 
restrict the parameter ranges using problem-specific information (domain knowl- 
edge). The “intelligent” initialization is based on the orientation of the skull to a 
frontal pose and the corresponding limitation of the rotation angles, which results in 
a significant reduction of the solution space, thus easing the problem solving. This 
new design exploits problem-specific information in order to achieve faster and more 
robust solutions. The performance of this method outperformed their previous 
approach (Ibáñez et al. 2009a). 

Ibáñez et al. (2011) extended their previous approach (Ibáñez et al. 2009a), 
considering the uncertainty involved in the location of the cephalometric landmarks. 
In particular, they made use of fuzzy logic to model the difficult task of locating the 
landmarks (Richtsmeier et al. 1995) in an invariable place, with the accuracy needed 
by CES. By the location of a larger number of cephalometric landmarks (precise and 
imprecise), the automatic SFO method is able to overcome coplanarity problems 
(Santamaria et al. 2009b) and it achieves a more robust performance. Fuzzy land- 
marks are regions on the face image that are provided by the forensic anthropologists 
when it is not possible to determine an accurate location for the cephalometric 
landmarks. The main drawback is the increasing computational time needed to 
perform an automatic SFO. In order to reduce the runtime while improving the 
accuracy and robustness, the same group of authors presented a novel SFO approach 
(Ibáñez et al. 2012b). It was based on a cooperative coevolutionary algorithm 
(Paredis 1995), which is able to look for both the best projection parameters and 
the best landmark locations (inside a given imprecise region) at the same time. 
Promising results were achieved, dramatically reducing the runtime required by their 
previous work (Ibáñez et al. 2011). 


4.4.4 Decision Making 


Once SFO is achieved, the decision-making stage can be tackled. The straightfor- 
ward approach would involve measuring the distances between every pair of 
landmarks on the face and on the skull. Nevertheless, this is not advisable, because 
errors are likely to be accumulated during the process of calibrating the size of the 
images. Instead, studies based on proportions between landmarks seem to be 
preferred. Geometric figures like triangles or squares are good choices. It is also 
important to consider as many landmarks as possible and different proportions 
among them (George 1993). Although the methods described in the following are 
usually called computer-aided CFS in the literature, we prefer to refer to them as 
decision-making methods, since we think that the authors fail to specify the correct 
CFS stage in which their works are included. Indeed, the proposed automatic 
techniques focus mainly on the decision-making strategy as they are actually 
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decision support systems assisting the anthropologist in making the final identifi- 
cation decision. 

These algorithms are applied on the digitized images stored in the computer, after 
the determination of the orientation and size of the skull by “routine” SFO 
techniques. 

Tao (1986) developed the first procedure in which a computer was used for the 
decision-making stage. That decision support system aimed to replace the previously 
used methods based on range estimation and subjective judgment. The system 
provided an identification conclusion by using distances between landmarks from 
the superimposed images. Later, Lan and Cai proposed the use of 52 different 
superimposition identification indexes in the TLGA-213 system, with the same 
aim (Lan and Cai 1988, 1993; Lan 1990). Those indices were based on 
anthropometrical measures of Chinese adults, male and females, and were used 
together with proportions and distances between superimposed landmark lines to 
automatically compute the final identification decision. 

Pesce Delfino et al. (1986, 1993) applied k-th-order polynomial functions and 
Fourier harmonic analysis to assess the fit between the outline of the skull and the 
face. Ten cases including positive and negative identifications were investigated. 
The polynomial function was used to smooth the curve representing the investigated 
profile. The square root of the mean square error was taken to calculate the distance 
between polynomial function curves obtained for the skull and the face profiles. The 
Fourier analysis considered each profile as an irregular periodic function whose 
sinusoidal contributors are found. Low-order harmonics (the first three or four) 
represented the basic profile shape and the high-order harmonics corresponded to 
the details. The sum of the amplitude differences of the sinusoidal contributors 
between profiles of the skull and the face represented the second independent 
parameter for numerical comparison. A Janus procedure (so-called by the authors 
because of the double-headed Latin god Janus, the bi-front) was used to evaluate the 
symmetry differences between the two profiles. This procedure takes into account 
the relationship between the total arc and the chord length and the area they delimit 
in the two-faced profiles. All these parameters are calculated by a computer software 
package called Shape Analytic Morphometry. However, this method would be only 
applicable when lateral or oblique photographs are available. Furthermore, their 
contribution requires manual repositioning of the skull for the correct 
superimposition. 

Bajnóczky and Királyfalvi (1995) used the difference between the coordinate 
values of pairs of anatomical and/or anthropometrical points in both skull and face 
for judging the match between the skull and facial image obtained by the superim- 
position technique. Eight to twelve pairs of points were recorded and expressed as 


4 Although the reviewed systems are labeled as automatic, in the sense that they are able to provide 
an identification decision without the intervention of the forensic expert, the supervision and final 
validation of the latter is always required as in any computer-aided medical diagnosis system 
BERNER, E. S. 2007. Clinical decision support systems: theory and practice, Springer. 
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pixel units. Then, the final matrix, containing coordinates of measured points and 
calculated values, was established by computer-aided processing. Lacking the 
appropriate information, their model assumed that all data in that matrix was 
independent and followed a normal distribution with the same variance. A part of 
that variance was o”, which was the square of the measurement error and was itself 
assumed to be the same for all the data. The model of the authors was based on 
assumption that 

The components of the error term are independent and distributed according to 


n(o. 20°). (4.1) 


The authors used a presupposed value of o as part of the model assumption. 
Under the assumption that the null hypothesis (Eq. 4.1) is valid, it was statistically 
tested using two values for o. The authors claimed that, when a given case is 
evaluated, it is crucial to know what value can be considered as measurement 
error. One skull and two photographs were used to test the method. Both frontal 
and lateral face photographs were considered. They noted that their method is 
suitable for filtering out false-positive identifications. Although the results obtained 
from this method are objective and easily interpreted for lay people, the anatomical 
and anthropometrical consistency between the skull and the face should be assessed 
by forensic examiners who are well versed in the anatomy of the skull and face. The 
authors concluded that their method should be used only in combination with classic 
video superimposition and could be regarded as an independent check. 

In Yoshino et al.’s skull identification system (Yoshino et al. 1997), the distance 
between the landmarks and the thickness of the soft tissue of the anthropometrical 
points are semiautomatically measured on the monitor for the assessment of the 
anatomical consistency between the digitized skull and face. The consistency is 
based on 13 criteria that they previously defined using 52 skulls (Yoshino et al. 
1995). The software includes polynomial functions and Fourier harmonic analysis 
for evaluating the match of outlines such as the forehead and mandibular line in both 
digitized images. To extract the outline, gradient and threshold operations are used. 
Five case studies were carried out. However, they noted that this analysis could not 
always be applied because of the difficulties in extracting the facial contour from 
small and poor facial photographs offered by the victim’s family. 

Skull-face overlay was guided by different crosses that were manually marked by 
the human operator in both the face and the skull radiograph photographs in Ricci 
et al. (2006). Once that stage has been completed, the algorithm calculates the 
distance moved for each cross and the respective mean in pixels. The algorithm 
considers a 7-pixel distance a negligible move. The mean value of the total distance 
moved represents the index of similarity between the given face and skull: the 
smaller the index value, the greater the similarity. The algorithm suggests an 
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identification decision based on that index of similarity. The authors claim 100% 
correct identifications over 196 cross-comparisons and report that the minimal 
number of landmarks required is 4. 

In Birngruber et al. (2010), the portrait image and the image of the aligned skull 
are compared at the same scale and morphological matches are searched for, such as 
the general length and width of the face or the deviation of the bridge of the nose. 
The facial proportionality of the portrait and the aligned skull should be in accor- 
dance with horizontal lines drawn through the middle of the eyes, the spina nasalis, 
and the mouth. 
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Chapter 5 A 
Craniofacial Superimposition: State iin 
of the Art 


5.1 Introduction 


A complete analysis of the scientific literature concerning cases resolved using CFS 
was conducted to ascertain the prevalence of CFS use among forensic scientists. 
However, since many experts working with CFS may not have published their 
activity in the field, a survey was launched among anthropologists by the “Method- 
ologies and Protocols of Forensic Identification by Craniofacial Superimposition” 
(MEPROCS) project, a project which aimed to propose a common EU framework to 
allow the extensive application of the CFS technique in practical forensic identifi- 
cation scenarios, commonly tackled by the European scientific police units. 

The questionnaire was prepared by the European Center for Soft Computing 
(Spain), based on the requirements and scientific experience of forensic investigators 
from the University of Granada (Spain), Coimbra University (Portugal), Guardia 
Civil (Spain), and Israel Police. This survey was sent to approximately 600 forensic 
scientists worldwide, over a period of 3 months. The data was provided by forensic 
investigators from universities and law enforcement agencies from 32 countries in 
North, Central, and South America; Europe; Asia; and Africa. A total of 97 responses 
were received. Of these, 45 investigators answered that they have used CFS as a 
method of identification in diverse investigations. 

The survey was composed of 16 questions addressing issues related to the number 
of cases undertaken in the last 30 years; classified according to different identifica- 
tion scenarios (mass graves, terrorism, missing persons, and common graves); the 
number of hours employed conducting CFS; identification results; whether the 
results were presented in court; the materials, tools, and techniques used; and the 
main problems faced in the application of CFS. 

Of the 97 responses, 56% were positive, that is, the investigator reported using 
CFS on a regular basis or having used CFS in the past. The following report 
addresses only the positive responses. 
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5.2 Use of the Technique 


From the MEPROCS survey, a total of 3854 cases of CFS were reported: of these, 
2744 (71.2%) were presented in a court of law and 1246 (32.3%) of them resulted in 
a positive identification. Most cases (2489) were not classified by the responders into 
any of the categories suggested in the survey. The following sections are devoted to 
an in-depth analysis of participant responses, according to the main issues asked. 
The data was provided by forensic investigators from universities and law enforce- 
ment agencies worldwide. 

Over 50% of the investigators have implemented CFS in only a small number 
instances (1-10 cases over a period of 10 years) mostly in missing persons or 
homicide investigations, while the remaining respondents reported a larger caseload 
(more than 20 cases). 


5.2.1 Identification Scenarios and Nature of the Investigation 


According to the identification scenario, we have defined a classification system 
based on the number of candidates to be identified and the number of possible 
matches: one candidate, an open list, or a closed list of candidates. The open list is 
considered an event that results in the death of an undetermined number of unknown 
individuals, for whom no data or records are available. Closed lists, on the other 
hand, are those in which death has occurred to a known group of identifiable people. 
The first category of this classification is the presumed identity of only one candidate 
(PIOI). The second and third categories are either the presumed identity of an 
individual within a closed list of possible candidates, PICL, or the unknown identity 
of an individual within a closed list of possible candidates, UICL. The last category 
is the unknown identity of an individual within an open list (UIOL). Finally, CNC 
denotes those cases not classified by the responders. 

Table 5.1 shows the classification of the total number of CFS cases reported by 
the participants in the survey according to the nature of the investigation. The most 
common scenario is the presumed identity of only one individual candidate 
(545 cases) The two different categories considering a closed list include 
670 cases, while the open list was applied in at least 150 cases. 

All cases were further classified based on the nature of the investigation 
addressed. We have distinguished the following four: 


— Mass disasters are defined as natural or man-made events, which cause death or 
injuries to large numbers of individuals. These include natural disasters caused by 
floods, climate and geophysical phenomena and epidemics or pandemics, and 
man-made disasters, caused by man's actions, intentional or otherwise, such as, 
wars, civil disasters, or accidents. 

— Terrorism can be defined as a human activity designed to cause harm, using 
premeditated violence with political or religious purposes. 
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Table 5.1 Use of CFS reported by 45 investigators 
Positive 

Scenario” | identification Exclusion | Undetermined | Not classified | Total 

PIOI 451 (11.7%) 33 (0.9%) | 61 (1.6%) - 545 (14.196) 
PICL 309 (8.096) 4 (0.1%) | 19 (0.5%) - 332 (8.696) 
UICL 336 (8.7) - 2 (0.1%) - 338 (8.8%) 
UIOL 150 (3.996) - - - 150 (3.9%) 
CNC - - - 2489 (64.6%) | 2489 (64.6%) 
Total 1246 (32.3%) 37 (1.0%) | 82 (2.1%) 2489(64.6%) | 3854(100.0%) 
“Scenario abbreviations: PIOI presumed identity of only one individual candidate, PICL presumed 


identity of an individual within a closed list of possible candidates, UICL unknown identity of an 
individual within a closed list of possible candidates, UJOL unknown identity of an individual 
within an open list, CNC cases not classified by the responders 


Table 5.2 Classification 


oblidat Nature of the investigation Cases 

results obtained in the surve : 

according to the nature of da Terrorist attack 15 (0.4%) 

investigation Missing persons 458 (11.9%) 
Mass casualty 130 (3.4%) 
Mass grave 87 (2.2%) 
Other 3164 (82.1%) 
Total 3854 (100.0%) 


— Missing persons, in accordance with the RCIC (Red Cross International Com- 


mittee), are those persons about whom their families have no news of and/or who, 
on the basis of reliable information, have been reported missing as a result of an 
armed conflict, international or noninternational, cause of internal violence, 
internal disturbances, or any other situation that might require the intervention 
of a neutral and independent public authority or when bodies lack information for 
identification, pursuant a medico-legal investigation of deceased person. 


— Mass graves are places where an undetermined number of individuals are buried 


as a consequence of war, guerrilla warfare, or as a result of mass disasters. Often, 
the exhumation and study of skeletal remains from mass graves involves a long 
and costly set of procedures. A number of protocols have been suggested; mostly 
modified from the UN Manual on the effective prevention and investigation of 
extralegal, arbitrary, and summary executions (Pesce Delfino et al.1993), in 
which five different phases for the study of skeletal remains are suggested: 
preliminary investigations, exhumation research, forensic study, final report, 
and final destination of skeletal remains (Ibáñez et al.2009b). 


Table 5.2 summarizes the responses according to the scenario in which CFS was 


applied. Unfortunately, most of the survey participants (82.196) did not classify their 
cases. 
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Table 5.3 CFS cases Continent/country Percentage 
grouped by county Central and North America 3.8 
Mexico 2.7 
USA 1.1 
South America 30.3 
Brazil 0.2 
Chile 0.1 
Peru 25.4 
Uruguay 4.6 
Asia 61.4 
China 15.6 
Japan 0.4 
Jordan 0.1 
India 38.2 
Russia 5.6 
Turkey 1.5 
United Arab Emirates 0.0 
Europe 4.6 
Spain 0.8 
Denmark 0.3 
Italy 0.5 
Lithuania 2.1 
Netherland 8 0.2 
UK 7 0.2 
Romania 20 0.5 
Total cases 3854 100.1 


5.2.2 Geographical Distribution 


The global distribution of CFS identification cases between the different continents 
and countries is summarized in Table 5.3. India is the country in which most cases 
have been reported (1471), followed by Peru (980). 


5.3 Methods and Tools 


The investigators were asked to report on the method (manual, semiautomatic, or 
fully automatic) and type of CFS technique used, as well as the source of material 
(photograph, video image, or digital) for superimposition. Table 5.4 presents the 
distribution of the various techniques reported. 

The tools required during the implementation of the technique are presented in 
Table 5.5. 
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Table 5.4 Distribution of reported techniques 


Photographic Video Computer assisted 
superimposition | superimposition | superimposition Total responses 
Manual 20 3 8 31 
Semiautomatic | 10 3 5 18 
Automatic 11 1 2 14 
Total 41 7 15 63 
Table S.S Tools Response Chart Percentage Count 


implemented in technique 


X-rays 12 4 


CTs 12 4 


3D Scanner 12 4 


Video system 15 6 


Skull bench 15 5 


Others 39 13 


B 
B 
u 
[3 
m 
Photoshop ===] 61 21 
E 


Total responses 34 


Other responses included software such as Photomodeler, Freeform Modeling 
System, Powerpoint, Geomagic, and 3Dmax. Hardware used included Phantom? 
haptic devices, photographic cameras, and various types of scanners. 

Tables 5.4 and 5.5 appear to present some inconsistencies. These can be 
explained by the lack of proper differentiation between the three CFS methods 
(photo, video, and computer). While only 14 of the investigators answered that 
they used computer-assisted superimposition, at least 20 of them reported that they 
used computer software (Photoshop! to perform the superimposition. 

These types of responses are expected as the scientific literature on the subject 
does not make a clear differentiation between the three categories. Similarly, there is 
also an inconsistency regarding the modality (manual, semiautomatic, automatic). 
For instance, 11 investigators responded that they utilized automatic photographic 
superimposition, when in fact to our knowledge, there is not a single automatic 
method or system of photographic superimposition. 


5.3.1 Landmarks 


Finally, the anthropological landmarks were addressed. The investigator responses 
regarding the landmarks utilized are presented in Table 5.6. 

Other landmarks included general shape of the skull, contour of the face and skull 
vault, orbital measurements, orbital shape, eye width, Whitnall's tubercle, chin lip 
fold, nasal outline (including asymmetry), tragus, position of auditory meatus, 
position of lips, dentition, chin, and mandibular angles. 
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Table 5.6 Landmarks used 


Response Frequency Count 
Glabella 38% 11 
Nasion 38% 11 
Rhinion 17% 5 
Nasospinale-Subnasale 28% 8 
Alare-Alare 31% 9 
Subspinale-Superior labial sulcus 24% de 
Prosthion-Upper lip border (Labiale superius) 34% 10 
Infradentale superius-Lower lip border 17% 5 
Incisor superius-Stomion 10% 3 
Supramentale-Labiomentale 14% 4 
Gonion 38% 11 
Zygion 31% 9 
Orbitale-Infraorbital 17% 5 
Supraorbital 10% 3 
Porion 17% 5 
Supraglenoide 10% 3 
Dacryon-Endocanthion 34% 10 
Gnathion-Menton 21% 6 
Gnathion 38% 11 
Pogonion-Mental 14% 4 
Pogonion 14% 4 
Prosthion 24% 7 
Menton 1% 2 
Ectoconchion 38% 11 
Frontozygomatic suture-Ectocanthion 21% 6 
Other 62% 18 


5.3.2 Literature Review 


The statistics obtained in the survey were similar to the data found in the literature. 

Table 5.7 presents an analysis of the manuscripts reporting case studies solved 
using CFS. All of the papers reviewed were classified according to the nature of the 
investigation, identification scenarios, and results. 

The literature reviewed for the project revealed that 26 articles had addressed the 
nature of the investigation in which CFS was implemented and, later on, had 
undergone judicial scrutiny. Of these, 8% relate to missing persons” identification 
(Ross 2004; İşcan et al. 2005), 4% were terrorist attacks (Indriati 2009) and 4% of 
the articles relate to mass casualty scenarios (Al-Amad et al. 2006). It can be 
observed that 68% of cases comprised of the identification of one individual 
(PIOD (Birngruber et al. 2010; Gordon and Drennan 1948; Simpson 1943; Prinsloo 
1953; Sen 1962; Bilge et al. 2003; Pushparani et al. 2012; Ghosh and Sinha 2005; 
Shahrom et al. 1996; Ubelaker et al. 1992; Bastiaan et al. 1986; Puech et al. 1989; 
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Table 5.7 Classification of case studies 
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Author 


Glaister and 
Brash (1937) 


Nature of investigation 


Identification scenario 


Result 


TA MP | MCI | MG 


PIOC | PICL 


x 


UICL 


UIOL 


PI |E 


x 


Prinsloo (1953) 


Simpson (1943) 


Gordon and 
Drennan (1948) 


> 


Webster (1955) 


Sen (1962) 


Reddy (1973) 


McKenna et al. 
(1984) 


x | | M 


Teixeira (1985) 


Bastiaan et al. 
(1986) 


Webster (1955) 


Sen (1962) 


Puech et al. 
(1989) 


Ubelaker et al. 
(1992) 
Shahrom et al. 
(1996) 


Austin (1999) 


Solla and Iscan 
(2001) 


Bilge et al. 
(2003) 


Chai et al. (1989) 


Puech et al. 
(1989) 


Ghosh and Sinha 
(2005) 


Al-Amad et al. 
(2006) 


Fenton et al. 
(2008) 


Shahrom et al. 
(1996) 


Solla and Iscan 
(2001) 


Pushparani et al. 
(2012) 
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Teixeira 1985; Webster 1955; Austin 1999; Helmer 1987), 16% addressed CFS 
identification within a closed list of possible individuals (PICL) (Indriati 2009; 
Al-Amad et al. 2006; Glaister and Brash 1937; Gordon and Drennan 1948; Simpson 
1943; Prinsloo 1953; Sen 1962; Reddy 1973; Solla and Iscan 2001; McKenna et al. 
1984; Webster 1955), 8% of the papers reported on the exclusion of a presumed 
identity within a closed list of possible individuals (UICL) (Glaister and Brash 1937; 
Gordon and Drennan 1948; Simpson 1943; Prinsloo 1953; Sen 1962; Reddy 1973; 
Bilge et al. 2003; Pushparani et al. 2012; Ghosh and Sinha 2005; Webster 1955; 
Fenton et al. 2008), and 8% of papers were related to the identification of individuals 
whose identity was not presumed, within an open list of possible candidates. Half of 
the latter cases resulted in identification, and half resulted in exclusion (UIOL) 
(Al-Amad et al. 2006). 

It should be noted that a large number of the cases referred to judicial authorities 
included identification based on superimposition, corroborated by other identifica- 
tion techniques, that is, comparison of DNA profiles. When no corroboration could 
be obtained, the superimposition, together with the anthropological profile, was used 
as the method of identification. The majority of the articles were classified within a 
general category “others,” which in most cases included single case identification of 
cadavers in diverse taphonomic conditions, or the identification of historical figures 
such as Mozart (Puech et al. 1989). 


5.3.3 Conclusions 


The international survey on the use of CFS as a method of identification among 
forensic investigators is a unique tool that has provided an important insight into this 
state of the art of the technique. 

The results of the pertinent literature scrutiny and the survey conducted among 
forensic investigators seem to indicate that CFS is deemed as a reliable and efficient 
technique of identification, although implemented in conjunction with another 
method in many cases. From a total of 3854 cases reported worldwide, 32.3% 
resulted in the positive identification of remains, with 2744 (71.296) cases submitted 
to judicial scrutiny. 
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Chapter 6 
Ethical and Legal Issues in Craniofacial ciim 
Superimposition 


6.1 Introduction 


Methodology in craniofacial superimposition (CFS) relies on the knowledge of the 
anatomical relationship between the soft tissues of the head and the underlying 
skeletal and dental structures. This information is also critical to the closely related 
practice of facial approximation/reproduction. Craniofacial superimposition is usu- 
ally employed when a skull has been recovered and thought to perhaps be related to a 
particular missing person for whom ante-mortem facial photographs are available. 
Facial approximation refers to the process utilized to estimate a person's facial 
appearance from a recovered skull (Bilge et al. 2003; Pushparani et al. 2012; 
Al-Amad et al. 2006). Although both techniques can prove to be important in the 
investigation of missing persons, recovered remains, and events producing mass 
fatalities, this document specifically addresses ethical issues relating to research in 
the development of methodology for craniofacial superimposition. 

In recent years, as advances in forensic odontology, genetics, and anthropology 
have improved, so have the chances of identifying victims beyond recognition. 
According to the Interpol Disaster Victim Identification (DVI) Guide, fingerprints, 
dental examination, and deoxyribonucleic acid (DNA) are the primary identifiers 
(Schuliar and Knudsen 2012; Al-Amad et al. 2006). There are unmistakable reasons 
why these are the most reliable indicators of identity: fingerprints are unique, do not 
change, and can be classified, which enables them to be identified and registered 
systematically. Subsequently, the prints are then easily retrieved for purposes of 
comparison (Puech et al. 1989). 

The unique structures and traits of human teeth, dental restorations, and jaws 
readily lend themselves to use in the identification of living and deceased victims. 
Dental data can be recovered and recorded at the time of the post-mortem examina- 
tion and compared to ante-mortem data that is supplied by the generalist and/or 
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specialist dentists who treated the victim during their lifetime (Fernándes et al. 
2012). While an important and valuable identification method, dental identification 
is subject to the availability and quality of ante-mortem and post-mortem dental 
records (Al-Amad et al. 2006). 

Deoxyribonucleic acid is a proven source of material for use in identification, as a 
significant portion of the genetic information contained in a cell is unique to a 
specific individual and thus differs — except in identical twins — from one person 
to the next. DNA testing can be performed even in cases involving partial, severely 
decomposed remains. Additionally, DNA matching is the best way to identify body 
parts and can be based on profiles from relatives, self-samples, or belongings 
(Al-Amad et al. 2006). 

Secondary means of identification include personal description, medical findings, 
as well as evidence and clothing found on the body. These contributions serve to 
support identification by other means and are not ordinarily sufficient as a sole means 
of identification (Schuliar and Knudsen 2012), unless they have a rare identification 
potential, such as prosthetic devices, especially when they bear a serial number or an 
identification (ID) code. Face recognition is a natural human ability and a widely 
accepted identification and authentication method. In modern legal settings, consid- 
erable credence is placed on identifications made by eyewitnesses. However, these 
are based on human perception, which is often flawed and can lead to situations 
where identity is disputed. 

The craniofacial superimposition technique can contribute to the process of 
identification especially when there is no reference sample for a forensic DNA 
analysis, when DNA typing from remaining tissue samples has failed, or when 
ante-mortem dental records and comparative fingerprints are not available (2012). 

The aim of this chapter is to analyze ethical and legal issues involved in the use of 
craniofacial superimposition, considering the creation of a common multicentric 
framework that will allow the extensive application of the CFS technique in practical 
forensic identification scenarios. 


6.1.1 What Is Craniofacial Superimposition? 


This method consists of the superimposition of the image of the skull and a 
photograph of a missing person. It involves the comparison of specific landmarks 
on soft tissue and bone surfaces. The technique is employed in cases when human 
remains are found and are thought to possibly relate to a particular missing person. 
The method can be used when a photograph of the missing person taken during life 
is available, and molecular, odontological, and/or fingerprint data are not available to 
facilitate identification. 
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6.2 The Importance of Craniofacial Superimposition 
in Human Identification 


There are various situations in which craniofacial superimposition can be extremely 
useful. Examples include when a corpse is unrecognizable due to its state of 
decomposition, soft-tissue mutilation or incineration (2012), and in mass disasters, 
which are associated with a large number of fatalities, with victims being visually 
unidentifiable in most cases (Al-Amad et al. 2006). 

The method is mostly useful for exclusion. In such cases, observations of hard 
tissue landmarks on the recovered remains are sufficiently inconsistent with those on 
the ante-mortem photograph to suggest that the individual in the photograph could 
not be the person represented by the skeletal remains. 

In the application of this technique, an initial assessment involves comparison of 
all available features of the recovered remains with the superimposed ante-mortem 
photograph. If major differences are apparent, an exclusion can be concluded. If no 
significant differences are found, the examiner then must determine the uniqueness 
of the features compared. The extent to which a positive comparison contributes to 
the identification process depends upon the uniqueness of those features and the 
probabilities involved. 

The supporters of this method report that up to 96% of positive correlations can 
represent correct identifications, when both frontal and lateral superimposition views 
are utilized. However, anthropologists have varied opinions regarding the reliability 
and probabilities involved in this type of investigation. In our opinion, this method is 
best used in conjunction with others for identification, as there are several problems 
to overcome in the comparison between a soft tissues structure (face) and a structure 
made of hard tissue (skull). The SWGANTH document for best practices in facial 
approximation (Al-Amad et al. 2006) provides valuable commentary on the 
strengths and weaknesses of facial approximation methodology in its current state. 
While limited in scope, it can be useful for excluding identity if gross incompatibil- 
ities are present. 


6.3 Ethical Issues in Craniofacial Superimposition Methods 
Research 


Ethical issues relate to proper consent for the acquisition of documented data from 
known individuals, protection and proper storage of data, and appropriate scientific 
utilization of the data. 

The ethical issues in CFS methods vary according to their aim. First of all, it is 
necessary to find and develop the best method, which implies research using skulls 
(from both deceased and living individuals) to improve the technique and to create a 
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database that will allow the future application of these methods. In fact, it is an 
altruistic contribution, without any benefits for those people who participate. In the 
future, CFS will be used to assist in identification when recognition by other 
resources has failed, and thus will benefit society as a whole. 


6.3.1 The Groups Involved (Victims, Families, Professionals, 
and Societies) 


The primary groups of ethical concern are living individuals who contribute data, 
and the families of the deceased whose remains and photographs are utilized. Other 
groups of ethical interest include professional researchers, scientific organizations, 
project organizers, administrators, and those involved with data entry and the 
computer programming of the database. 

When we are analyzing the ethical issues of the CFS application, we must 
consider all the groups involved: the victims, their families, all the professionals, 
and, finally, society. 


6.3.1.1 The Victims 


The Universal Declaration on Bioethics and Human Rights aims “to promote respect 
for human dignity and protect human rights" (2012). According to the Convention 
on Human Rights and Biomedicine, “Parties to this Convention shall protect the 
dignity and identity of all human beings. . .” (2012). Additional declarations suggest 
similar ethical approaches when working with human subjects (Smeets et al. 2010; 
Claes et al. 2010; Al-Amad et al. 2006). Given these issues, we can say that victims 
are to be treated with dignity and respect, as human dignity persists beyond death. 
Everyone, dead or alive, deserves to be identified. 


6.3.1.2 The Families 


The family is essential in this whole process, through the cooperation they can 
provide by making available photographs, personal details, and otherwise assisting 
in the identification process. It is undoubted that cooperation on the part of relatives 
in the collection of ante-mortem data enhances the quality and speed of identification 
measures. However, we must not forget that they may need psychological support, 
and we must be able to provide it in every situation. They also deserve to pay a last 
tribute to their dead, so we should do our best to enable it in every situation. 
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6.3.1.3 The Professionals 


All participants in this proJect should demonstrate a scientific competence and 
adhere to ethical guidelines. Participants shall not misrepresent themselves or their 
work products, inappropriately utilize tangible or intellectual property, or through 
their actions or words indicate disrespect to the deceased, their family members, or 
others contributing data to this project. Participants should refrain from conduct 
adverse to the best interests of the professional scientific community. Participants 
should properly and accurately present their education, training, experience, and 
expertise. Participants should comply with all relevant laws, regulations, and poli- 
cies that relate to the acquisition, security, and use of data in this project, especially 
in relation to human remains. Participants should ensure that all scientific procedures 
meet professional standards. All professional activity should be carried out in a 
manner that inspires confidence in the project and the professional forensic science 
community. 

The professionals working in this area have to bear in mind that the most 
important requirement for victim identification work is the application of Interna- 
tional standards (The Scientific Working Group for Forensic Anthropology 2012c). 
In this context, it is indispensable that the highest possible quality standards will be 
applied, not only for procedures and equipment, but also with regards to human 
resources (1997, 2005). It means that everyone has to be well trained and has to 
strictly follow all the procedures. As the team is frequently the point of contact for 
relatives within the context of family assistance, they also have to be trained to 
provide this kind of support. 

In the CFS research, the professionals involved must act according to the “four 
principles” approach, postulated by (1964): 


° The respect for autonomy—by which the patient has the right to accept or refuse 
any procedure; in this particular case, no images can be used unless informed 
consent is provided. 

° Beneficence—every practitioner should act in the best interest of those providing 
data. As discussed above, in the initial research phase, the benefits we can achieve 
are the reliability and accuracy of this technique, in order to be safely used in the 
future. When CFS is used as a tool to help identify nameless individuals, all the 
professionals should do their best, not only technically, but also by providing 
psychological support to the victims’ families. 

* Non-maleficence—the “first, do no harm" principle can be applied as a way to 
minimize the possibility of a misrecognition, which carries tough legal, social, 
and religious issues. 

° Justice—it generally concerns the distribution of scarce health resources, and the 
decision of who gets what treatment (fairness and equality). In this particular 
field, efforts must include widely informing all concerned individuals about the 
MEPROCS framework, and in the last step, this technique should be equally 
available to every partner. 
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Another value which is sometimes discussed includes the respect for persons— 
the individuals providing data have the right to be treated with dignity. In addition, 
families of the deceased have the basic human rights for the identification of their 
loved ones. 


6.3.1.4 Society 


Society increasingly wants to be up to date, seeking information about missing 
persons and requiring that every effort should be undertaken to find them. It is 
extremely important to know how to deal with media, and share only useful 
information, without risking the success of the investigation. When CFS is used to 
assist in the identification of criminals, it can also be considered an important matter 
of safety. 

Another important point we have to consider is the cost-effectiveness of the 
project. The costs of building an image database can be high, and the proportionality 
issue facing the benefits of its use has to be considered. On the other hand, the 
method’s limitations and the misidentification consequences make this technique 
itself an ethical issue. 


6.3.2 Databases for Craniofacial Superimposition Methods 
Research and Data Protection 


Databases raise ethical questions, and many reasons exist both for and against their 
creation. Two main advantages of their use are the possibility of accelerating the 
process of identification (in mass disaster situations), and of enhancing the efficacy 
of identification of a guilty or an innocent person. On the other hand, they risk 
violating the right to privacy, human dignity, the right to physical and moral 
integrity, the right to not testify, the innocence presumption, the right to health, 
and the right to freedom (Board 2012). 

Databases must be constructed in a manner to facilitate the research that is 
expected to be performed. The primary ethics issues in such database construction 
and maintenance involve protection of the data from improper use and viewing, 
limiting access to only those approved individuals and institutions and defining 
research protocols that limit applications. These ethical issues apply not only to 
the construction and initial research use of the database but also to its maintenance 
when the primary research is complete. 

A long-term goal should be the maintenance of the database, since scientific 
research represents an ongoing process as new problems and approaches are iden- 
tified. When we consider the creation of a database for CFS research, protocols of 
registration, collection, storage, and sharing data are needed. It is crucial to define 
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what images should be inserted, how they should be stored, how long they should be 
maintained in storage, as well as how and when this data should be shared. 

Considering all these issues, the MEPROCS’ database should be built after 
defining all previous issues. By using the principle of precaution, we have to prevent 
the slippery slope effect, as well as the risk of discrimination that the power of the 
organizations can exercise on the minor partners. It is essential to have a quality 
control system for this image database. 


6.3.2.1 Database Accessibility 


All the participants and partners in the proposal must obey national laws and 
European directives of privacy and data protection by ensuring that their employees 
and collaborators fulfill the appropriate procedures to handle sensitive 
electronic data. 

The personal information used during the project should be coded and encrypted 
following the practices approved by their respective local/national ethical commit- 
tees. The data will be accessible only for the participants involved in the project and 
a security policy should be generated and communicated to all the participants in the 
network. This security policy should also state the protected data transfer protocols, 
preferably by European secure network (as S-TESTA) that will be used to transmit 
confidential data. Such data will not be transferred to any person outside the 
network. The implementation of the security policy should be monitored by the 
ethics committee (EC). It is important to note that anonymous data is not considered 
personal data and the processing of this anonymous data requires less special 
safeguards. The data will be anonymous for the participants. Irreversible 
anonymization of data will be assured using a secured procedure to permanently 
delete the electronic data. Once data is anonymous, it does not require specific 
processing apart from the standard data protection procedures. Data will not be 
kept in an identifiable form in the resources of the partners. 


6.3.2.2 Privacy: Data Anonymity 


The Data Protection Act 1998 (the DPA) applies only to information, which falls 
within the definition of “personal data.” European data protection authorities have 
been considering what is meant by “personal data” in Directive 95/46/EC on the 
protection of individuals with regard to the processing of personal data and on the 
free movement of such data (the European Data Protection Directive, or the Direc- 
tive). This work has culminated in Opinion 4/2007 on the concept of personal data 
(01248/07/EN—WP136) adopted by the Article 29 Data Protection Working Party 
on June 20, 2007. 

The Data Protection Act (DPA) is concerned with “personal data.” Personal data 
means data that relates to a living individual who can be identified from the data or 
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from the data and other information, which is in the possession of, or is likely to 
come into the possession of, the data controller. 

In order to determine if the data under study is considered personal data, the 
following questions have to be answered (The Scientific Working Group for Foren- 
sic Anthropology 2012a): 


— Can a living individual be identified from the data, or, from the data and other 
information in the possession of, or likely to come into the possession of, the data 
controller? 

— Does the data “relate to” an identifiable living individual, whether in personal or 
family life, business, or profession? 


If the answer to any of the previous questions is yes, the data can be considered 
personal data in most of the cases. 

In the particular case of the data needed to perform CFS, neither the skull (the 
actual physical skull, photographs, or 3D models of it) nor the anthropological 
profile can be considered as personal data. Contrary to that, face photographs of 
living persons are considered personal data in the CFS scenario so they have to be 
treated as confidential data. Those photos will be processed to learn something about 
the individual. In addition, as mentioned before, face recognition is a natural human 
ability. 

The partners will make available anonymous data together with a unique coding, 
which falls short of actually identifying the individual to the MEPROCS partici- 
pants. By making data anonymous, the privacy of individuals will be maintained. 
Converting personal data into a form in which the individuals to whom it relates are 
no longer identifiable will be only possible in the case of the skull and anthropolog- 
ical profile. It is not possible to anonymize face photographs for CFS purposes since 
the task to be performed is exactly the contrary, individual identification. However, it 
is clearly legitimate to use personal data for particular purposes where the intention is 
to inform decisions about particular individuals, or to provide services to them, as is 
the goal of the current research study (2012). 

The process of anonymization (The Scientific Working Group for Forensic 
Anthropology 2012b) starts once a relative of the deceased decides to allow the 
use of data in the study. At this moment, the responsible person designated by the 
MEPROCS EC to carry out this process has to access the database, in which he/she 
will add files containing the reference of the data that is going to be introduced. 
These references and the file name will be a random code obtained using certified 
and secured commercial anonymization software. Then, the MEPROCS EC will 
ensure that the privacy supervisor designated in each center has verified that the files 
have been codified properly and that they comply with privacy rights. At this time, 
files can be transferred to the rest of the partners. Organizations holding the data are 
the guardians and should exercise due diligence with its protection. 

Finally, special attention will be given to the images that might be needed for 
dissemination outside the network (project reports, scientific papers, etc.). The 
research intending to use images in open dissemination publication and activities 
should seek explicit permission from the EC. A second check will be performed on 
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the medical images to ensure that it remains impossible for the public to identify the 
deceased from the data. 


6.4 The Problems of European and National Legislation 
and the Implications of Conventions and Declarations 


Every effort should be made to acquire data in a manner that is consistent with 
existing European and national legislation and policies. 

The MEPROCS international framework must respect international conventions 
and declarations, as well as the legal issues of all involved countries. It should be 
important that a legal expert from each country compiles his/her national legisla- 
tions, and assure that all MEPROCS’ documents comply with them. 

Participants must abide by the national legislation and regulations of the countries 
in which the project will be carried out. Furthermore, each participant will seek the 
approval of the relevant local or national ethics committee to start the research 
activities. 

Participants must conform to relevant EU legislation: Charter of Fundamental 
Rights, Decision N° 1982/2006/EC of the European Parliament and of the Council 
of 18 December 2006 concerning the 7FP for research, technological and demon- 
stration activities (2007-2013), the Directive 95/46/EC, and the Council of 
24 October 1995 on the protection of individuals with regard to the processing of 
personal data and of free movement of such data. 

Participants must abide by International conventions and declarations: Helsinki 
Declaration 1996/2000, UN Convention on the Rights of the Child, Convention of 
the Council of Europe on Human Rights and Biomedicine (1997), UNESCO 
Universal Declaration on Bioethics and Human Rights (2005), and W.H.O./C.IO. 
M.S. International Ethical for Biomedical Research Involving Human Subjects 
(1993, reviewed 2001). 

In addition, each MEPROCS full partner shall provide the Research European 
Agreement (REA) with written confirmation that it has received favorable opinion 
(s) from the relevant ethics committee(s) and, if applicable, the regulatory approval 
(s) of the competent national or local authority (ies) in the country in which the 
research is to be carried out, before beginning any REA-approved research requiring 
such opinions or approvals. The copy of the official approval from the relevant 
national or local ethics committees must also be provided to the REA. 


6.5 Proposed Guidelines for Craniofacial Research 


During the research process, all the participants must adhere to the proposed 
guidelines: 
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° In the acquisition of individual data, proper informed consent must be secured. 

° Procedures for obtaining informed consent should follow the guidelines and 
regulations of the countries and institutions involved. 

° Once properly obtained, individual data must be protected against inappropriate 
use. Such protection must include not only the usual computer firewalls but also 
clear procedures for screening access. 

° Use of the data should follow guidelines regarding the type of research conducted 
as well as defining those individuals/institutions with access. 

° Procedures should safeguard the identities of all individuals in the database. 


Research methods resulting from utilization of the database should relate the 
appropriate probabilities involved, including appropriate and adequate statistical 
procedures. 


6.6 Consent Forms for Craniofacial Superimposition 
Methods Research 


Informed consent represents an essential ethical cornerstone of database construc- 
tion. Protocols must be followed to ensure that data are properly acquired and that 
the necessary approvals are in place. As indicated above, the uses of CFS techniques 
vary according to particular project goals: research or real practice. In both cases, the 
use of official consent forms is mandatory. 

Although there are various models internationally for consent forms and pro- 
cedures, attached are consent forms that the ethics committee feels will meet the 
goals of this project (see Appendices A-C). 

To authorize the acquisition of individual data, there are two different MEPROCS 
Informed Consent Forms: one to be provided to the relatives of the deceased person 
that we will include in the study (Appendix A) and a second one regarding data 
collection from living individuals (Appendix B). These forms have been evaluated 
and approved by the Ethical Committee, as they comply with the ethical values and 
individual rights. They include a clause with the right to cancel the authorization at 
any time and state that the proposer will then erase any previous data or images. 

The process of obtaining informed consent is basic in the tasks of this project. 
First, a detailed explanation of how the project will be developed and what its 
objectives are has to be given to the victims” relatives, or the living individuals. 
With this aim, the persons in charge should show, in their respective center and using 
simple and a clear language, a PowerPoint presentation, explaining the details and 
the social benefits of the MEPROCS project. In order to help people in their 
understanding of the contents, they should also be provided with a short explanatory 
document. The next step should include personal interviews with each person to 
detail the most relevant aspects of MEPROCS. 

The principles of this practice are universal: people need to be adequately 
informed and they must clearly understand the information. Finally, they have to 
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make their own decision regarding the authorization to include their images in the 
database, freely and without coercion. In the case of children, incapable persons, or 
the deceased, the informed consent is usually given by a close relative or a procu- 
rator, always following the rules previously listed. 

Once all this information has been transmitted, they should be provided with an 
informed consent form so that they can accept, freely and without any kind of 
constraint, to participate in the project. 

In the event that data is imported, either from within the MEPROCS consortium, 
or from an external center/institution, the protocols must adhere to the general ethical 
guidelines provided in this document. 

When there are remains from individuals deceased for more than 15 years, and the 
national laws allow their sharing and use, the MEPROCS EC approves their 
inclusion in this study, after the signing of the “Informed Consent form for scientific 
material sharing” (Appendix C). 
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Chapter 7 
Experimental Study of Craniofacial ds 
Superimposition Methodologies, Tools, 

and Criteria 


7.1 Introduction 


The objective of this chapter is to analyze the reliability of different CFS method- 
ologies and the corresponding technical approaches to the CFS identification tech- 
nique. Moreover, we aim to examine the subjectivity and discriminative power of the 
different criteria (detailed in Sect. 7.2) for assessing the skull-face correspondence 
either proposed in the literature or by any of the MEPROCS partners. 

This novel study is expected to provide important insights to better understand: 
(1) which are the most convenient characteristics of every method included in this 
study, (2) which are the most and less discriminative criteria; and (3) which criteria 
are dependent more on the expert and which criteria are more independent, that is, 
less subjective. The two latter points could give an idea of how many and which 
criteria are needed to reach a reliable conclusion. Those criteria that are determined 
to be more discriminatory could be later included as a recommended standard 
for CFS. 


7.2 Study on the Performance of Different Craniofacial 
Superimposition Approaches 


7.2.1 Experimental Study 


Each participant was requested to tackle each of the provided cases using the typical 
protocol that they would follow at their institutions. The participants were requested 
to fill an identification form with description of the protocol/methodology (i.e., 
software, equipment, orientation process, landmarks, assessment criteria) employed. 
For each case, a final identification decision (either positive or negative) should be 
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Table 7.1 Summary of the characteristics of the datasets employed for the study 


# Positive cases 

Case # Skulls  |ZPhotographs | Candidates |ZSFO'S |Male set | Female set 
N1 1 3 3 3 1 0 

N2 1 3 3 3 1 1 

N3 1 3 3 3 0 1 

N4 1 3 3 3 0 0 

N5 4 4 4 16 2 2 

N6* 1 2 1 2 0 0 

N7* 1 2 1 2 2(1)" 2(1)* 
TOTAL |7 20 18 32(30)* 6(5)* 6(5)" 


“Although cases 6 and 7 are composed of two photographs, that is, they involve two SFOs, these 
two cases result in just one identification result, considering the matching of the skull over the two 
photographs 


reported along with the rationale supporting the decision and at least one image 
illustrating the overlay/superimposition outcome. 

The dataset used in this reliability test consisted of two sets, divided by sex, of 
seven CFS case studies each of them. These 14 CFS cases involve a total number of 
60 SFO problems as given in Table 7.1. The dataset was collected at the University 
of Tennessee after obtaining informed consent from the responsible party for the 
deceased, and provided to the MEPROCS project as data share protocol established 
through the University of Dundee. 

The dataset consisted generically of a set of ante-mortem photos, photos of the 
skull (with scales), and a set of 3D models of the skull acquired by laser scanning 
technology (Fastscan Polhemus Scorpion scanner). Physical 1:1 replicas of the skull 
3D models were provided to those participants performing video-superimposition. 
Each set of case studies had the following structure: cases 1—4 mimic a scenario with 
one skull and three possible candidates, where only one ante-mortem photo of each 
candidate is available. In case 5, a more complex scenario is simulated, including 
four skulls and four possible candidates, with only one available ante-mortem photo 
of each candidate. In cases 6 and 7, the scenario simulated includes one skull and 
only one possible candidate, with several photos of the candidate available for 
analysis (see Table 7.1 for the case studies detailed explanation). 

The performance of each participant was measured by computing true-positive, 
false-positive, true- and false-negative rates, and overall accuracy. All indicators 
were calculated for each sex and all case studies pooled together. Experience and 
familiarity with craniofacial identification techniques was also taken into account 
and level of experience of the participants was classified according to the following 
scheme: 


° No previous experience and no CFS-related training. 

° No previous experience but CFS-related training. 

° Short previous research experience and CFS-related training. 

° Moderate previous experience with CFS real cases and CFS-related training. 
° Broad experience with CFS real cases. 
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The study was carried out by 26 participants from the following institutions: 
University of Granada (Spain), University of Dundee (Scotland), Legal Medicine 
and Forensic Sciences Institute (Peru), North Carolina State University (USA), 
Complutense University of Madrid (Spain), University of Melbourne (Australia), 
Azienda Ospadaliera-Universitaria di Trieste (Italy), Russian Academy of Sciences 
(Russia), Portuguese Judiciary Police (Portugal), Moscow Region State Bureau of 
Forensic Examination (Russia), Spanish Civil Guard (Spain), Turkish Council of 
Forensic Medicine (Turkey), National Research Institute of Police Science (Japan), 
University of Milan (Italy), South African Police Service (South Africa), University 
of Vilnius (Lithuania), and University Sains Malaysia (Malaysia). In Table 7.2 all 
the participants (numbered from 1 to 26) are listed in the study with the 
corresponding level of experience. Since not all the participants completed the 
whole study, information of the dataset(s) tackled by each of them is provided as 
well. 

Tables 7.3, 7.4, 7.5, and 7.6 summarize the methodologies employed by the 
participants grouped by the technological approach followed. They were classified 
following the taxonomy given in The Scientific Working Group for Forensic 
Anthropology (2012b), that is, computer-aided semi-automatic 3D-2D superimpo- 
sition (Table 7.3), computer-aided manual 3D-2D superimposition (Table 7.4), 
computer-aided manual video superimposition (Table 7.5), and computer-aided 
manual photo superimposition (Table 7.6). The first column also indicates both the 
type of dataset used and the global performance. The datasets are either male, 
female, or both. The global performance of the participant methodology refers to 
the percentage of correct decisions. Significant details of each of them are briefly 
explained according to software and equipment employed, how the SFO process is 
tackled, and the kind of skull-face relationship assessment made (decision making). 


7.2.2 Results 


A total number of 1152 CFS problems have been tackled within this study. While 
previous Tables 7.3, 7.4, 7.5, and 7.6 reported on the global performance (correct 
decisions) of each participant-methodology, the following three tables report the 
results obtained by each participant, considering separately the two different datasets 
independently (Tables 7.7 and 7.8, male and female respectively) and both together 
(Table 7.9). Detailed performance indicators such as true positive (TP), false positive 
(FP), true negative (TN), and false negative (FN) are given in any case. 
Considering only the global performance, participants P2, P3, and P4 achieved 
the higher rates surpassing 90.00% up to 94.29% achieved by P4 (Tables 7.3 and 
7.4). They share a similar SFO approach (computer-aided 3D-2D), although P2 
made use of a semiautomatic software. During the decision-making stage, they all 
employed the morphological criteria in Wilkinson (2004), and two of them also 
analyzed the criteria introduced in Austin-Smith and Maples (1994) and Yoshino 
(2012). However, only P2 tackled both female and male datasets. Similar 
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Table 7.3 Summarization of computer-aided semiautomatic 3D-2D superimposition (CAs3DS) 
approaches that participated in the study 


Participant 

number and 

global Software and 

performance | equipment Skull-face overlay Decision making 

P2 Face2Skull™ | Automatic SFO by matching Followed guideline and 

Both datasets cranial and facial landmarks criteria proposed in Austin- 

91.43% (manually located). Manual Smith and Maples (1994), 
refinement of the overlay when | Yoshino (2012), Wilkinson 
needed. (2004). 

P19 3D-TADD Used 3D-TADDsoftware to Morphological and landmark 

Both datasets scale the photograph and posi- | assessment. 

83.01% tion the 3D model. Anatomical points and con- 


tours of the head, the middle 
and lower part of the face, 
eyebrows, ears lobes, the line 
between the lips, the wings of 
the nose and supramental 
furrow are automatically 
detected. Manual refinement 
of points and contours when 
needed. 


performances were obtained by P26 (88.30%) and P18 (87.69%). While the first 
followed video superimposition approach, the second employed computer 3D-2D 
software. Again, a morphological approach was the key aspect, leading their 
skull-face relationship assessment. From these rates, participants’ performance 
decreases almost linearly until the worst results by P23, who based both the SFO 
and decision making in a landmark comparison. 

Looking deeply at the individual performance, it is quite obvious that higher rates 
of true negatives were achieved in comparison to true positives. Just focusing on 
those participants who carried out the study over both male and females datasets 
(Table 7.9), we observe that four of them achieved true negative rates equal or higher 
than 90.00% (P2, P14, P18, P26). However, the same four participants achieved 
80.00%, 50.00%, 62.50%, and 66.67% of true positive, respectively. According to 
the average behavior considering the two datasets, the mean true positive rate is 
52.63%, while the mean true negative rate is 84.20%. Consequently, the false- 
positive rate is significantly lower than the false-negative rate. It is important to 
remark that the number of negative cases (50) is five times the number of positive 
cases (10). 

Table 7.10 reports performance indicator of the different participants — method- 
ologies grouped by the level of experience of the participant. There are not signif- 
icant differences related to the level of experience of the participants. There is not a 
correlation between the performance and the level of experience of the practitioners. 
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Table 7.4 Summarization of computer-aided manual 3D-2D superimposition (CAm3DS) 
approaches that participated in the study 


Participant 
number and Anatomical 
global Software and consistency 
performance | equipment Skull-face overlay | assessment criteria | Observation 
P4 Freeform Model- | The cranium was | The resulting The software has 
Male dataset | ling Plus orientated first ina | images were then | two variables to 
94.29% Phantom® Desk- | trial and error imported into “play” with the 
top™ Haptic manner, by means | Adobe Photoshop | camera 
Device of moving and and outline trac- projection. 
Adobe rotating the stylus | ings of the skull 
Photoshop™ of the haptic and face were pro- 
Wacom tablet device. Starting duced using 
points for the Wacom tablet. 
alignment were Morphological 
eyes/orbits in con- | assessment based 
junction with on Austin-Smith 
either the maxil- and Maples (1994), 
lary teeth, if visi- | Yoshino (2012), 
ble, or the nasal Wilkinson (2004). 
bridge. 
Follow “fuzzy 
landmarks” and 
morphology for 
orientation. The 
mandible was ori- 
entated in compli- 
ance with the 
facial expression 
and the limits of a 
physiologically 
natural position. 
P3 Freeform Model- | Manual orienta- Morphological Haptic device 
Female ling Plus tion with software | assessment based used for moving 
dataset Phantom® Desk- | and haptic device. | on (Wilkinson the mandible. 
91.43% top™ Haptic Anatomical 2006). 
Device criteria of mor- 
Adobe phological assess- 
Photoshop™ ment taken into 
account during 
this process. 
P18 Blender Manual orienta- Morphological 
Both Adobe tion using Blender | assessment. 
datasets Photoshop™ and Photoshop. 
87.69% 
P14 Geomagic Stu- Geomagic Studio | Landmark and Consider first 
Both dio10 used to articulate | morphological biological profile, 
datasets (3D software) cranium and man- | consistency asymmetries, and 
85.71% Adobe dible. analysis. pathologies. Give 


Photoshop™ 


CS6 


Orientation of the 
skull by trial and 


special 


(continued) 
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Participant 
number and 
global 
performance 


Software and 
equipment 


Skull-face overlay 


error manipulation 
of the 3D skull 
model using 
Photoshop 


Anatomical 
consistency 
assessment criteria 


Observation 


consideration to 
teeth comparison. 


P20 
Male dataset 
81.66% 


Autodesk 3D 
Studio MAX 
Photoshop™ 
CS6 


Orientation (yaw, 
pitch and roll) set- 
ting in the same 
plane porion, tra- 
gus, Whitnall’s 
tubercle, and 
ectocanthion 
(Fenton et al. 
2008). 


Morphological 
(outlines) and 
landmark matching 
assessment. 


Asymmetries are 
key signs for 
individualization. 


P21 
Male dataset 
81.82% 


Adobe 
Photoshop™ 


Both 3D model 
and AM photo 
oriented and 
resized in 
Photoshop. 
Separate use of 
cranium and 
mandible. 


Morphological and 
landmark 
assessment. 


P5 
Both 
datasets 
80.8896 


Adobe 
Photoshop TM 
CS3. 

3D Max Studio 
2011 


Orientation and 
overlay achieved 
using software 
tools. Process 
guided by recom- 
mendations pro- 
posed in Lan and 
Cai (1993). Use of 
morphometric 
planes, and land- 
marks from Mar- 
tin and 

Saller (1966). 


Recommendations 
by Lan and Cai 
(1993). Morpho- 
logical assessment. 


Pl 
Both 
datasets 
79.10% 


RapidForm 2006 
Adobe 
Photoshop™ 


3D skull model 
oriented by simul- 
taneous view of 
the model and the 
AM photo. 
Resize of the 
image according 
to cranial and 
facial landmarks. 


Followed criteria 
described in 
Navarro- 

Merino (2011). 


P17 
Both 


Craniofacial cor- 
respondence 
analysis program 


The program rep- 
resents the algo- 
rithm of 


The program of craniofacial correspon- 
dence based on the data on soft facial 
tissue thickness and on the analysis of 


(continued) 
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Table 7.4 (continued) 


Participant 
number and Anatomical 
global Software and consistency 
performance | equipment Skull-face overlay | assessment criteria | Observation 
datasets (in-house transformations relationships between facial and skull 
71.19% software) from dimensional | features, correlative and regression 
and descriptive analysis of the facial and skull features, 
traits of a skull as well as a descriptive analysis of 
into the indexes and variations of categorical 
corresponding and quantitative characteristics. 
parameters of 
the face. 
P15 Geomagic Studio | The 3Dscan is Morphological and | Geomagic is also 
Both software 3D rotated manually landmark used to complete 
datasets Rugle (using 3D Rugle) | assessment. the mandible 
76.81% through all possi- articulation. 
ble axes (X, Each photograph 
YandZ) to Frank- is cropped and 
fort horizontal resized to maxi- 
plane. The orien- mize the dimen- 
tation of the skull sions of the face 
is then electroni- in the frame. 
cally realigned so 
that the anatomi- 
cal position 
becomes the 
starting position. 
P22 Claytools The obj 3D data Morphological and | A perspective 
Both Geomagic, Inc. both of “cranium” | landmark assess- effect can be vir- 
datasets 3D Rugle and “mandible” ment (measure dis- | tually applied to 
71.43% Adobe were imported to a | tances between the 3D skull data 
Photoshop™ 3D modeling tool, | landmarks). using this soft- 
Elements Claytools ware (3D Rugle). 
(Geomagic, Inc.). 
A craniofacial 
superimposition 
was performed 
with “3D Rugle” 
software. These 
are imported to an 
Adobe Photoshop 
Elements software 
and superimposed 
again. 
P16 Rhinoceros© or | Right size is Morphological and | Generally do not 
Both Autodesk 3D established from landmark use 3D laser scan, 
datasets StudioO software | inter-Whitnall’s assessment. because partici- 
67.2496 Adobe malar tubercular pants have access 


Photoshop™ 


software 


distance and/or 
glabella-gnathion 


to a CT-scan with 


0.5 mm isotropic 


(continued) 
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Participant 
number and Anatomical 
global Software and consistency 
performance | equipment Skull-face overlay | assessment criteria | Observation 
distance. voxel that helps 
Orientation is in obtaining a 
established very anatomi- 
matching cally detailed 3D 
Whitnall’s malar image. 
tubercles—porion, 
where possible. 
Superimposition 
based on shapes. 
Landmarks help 
guiding the 
process 
P23 Geomagic Studio | Landmark-based Landmark-based 0, 1, or 2 dis- 
Male dataset | software orientation fol- consistency analy- | agreements of 
55.88% 3D Studio Max lowing Gordon sis following landmarks are 
software and Steyn (2012). | Gordon and considered a pos- 
VAM Steyn (2012). itive match. 3 or 
software more a consid- 
ered a negative 
match. 


While the participants who achieve higher rates of correct decisions are in category 
3 (84.68%), those generating lower results are, surprisingly, category four, together 
with category two grouped participants with the lowest performance (75.00% and 
74.32%, respectively). 

Finally, Table 7.11 depicts the overall accuracy according to the technological 
approach used by each participant. In overall, the approach followed by Participants 
2, 3 (CAm3DS approach) and 24, 25, and 26 (CAmVS approach) is the most 
accurate (88.49% and 84.56%, respectively). These technological approaches rep- 
resent the past and the future of the CFS technological development. 


7.2.2.1 Set of Criteria for Assessing the Skull-Face Overlay Relationship 


With all the data generated, some of the most representative experts in craniofacial 
identification joined in a discussion intended to identify and agree on the most 
important issues that have to be considered to properly employ the CFS technique. 
Tables 7.12, 7.13, 7.14, and 7.15 depict the identification of a set of common criteria 
for assessing the skull-face correspondence. 


114 


7 Experimental Study of Craniofacial Superimposition Methodologies. . . 


Table 7.5 Summarization of computer-aided manual video superimposition (CAmVS) approaches 
that participated in the study 


Participant 
number and 
global 
performance 


Software and 
equipment 


Skull-face overlay 


Decision making 


P24 Digital video The orientation was done by | First, the correlation of the 
Mala dataset | mixer, digital aligning: Whitnall’s tubercle | shape characteristics 
80.00% video camera, and | with ectocanthions; external | between facial skeleton and 
screen monitor auditory meatus with the tra- | face in the photograph was 
gus; vertical midline of the compared. 
face using the glabella, Then, morphological 
nasion, anterior nasal spine, | assessment was performed. 
prosthion, menton, and 
pogonion. 
The size was adjusted taking 
soft tissue depth into 
consideration. 
P25 Digital video Skull: (1) orientated on an Morphological assessment 
Both mixer, digital own-made support enabling | of landmarks and outlines. 
datasets video camera, and | rotation in three planes; 
83.33% screen monitor (2) zoomed in/out manually 
AVerMedia TV by video camera to obtain 
Series Product corresponding size; 
(3) rotated manually to 
obtain best position 
according to vertical (gla- 
bella-nasion-prosthion), hor- 
izontal (ectocanthion- 
ectocanthion and porion- 
porion, when available) and 
anteroposterior (prosthion- 
porion) planes. 
P26 Adobe Follow the procedure Asses traits indicated in 
Both Photoshop™ CS3 described in Jayaprakash Jayaprakash et al. (2001). 
datasets Video system et al. (2001) 
88.13% (Wilkinson 2004) 


Table 7.6 Summarization of computer-aided manual photo 
approaches that participated in the study 


Participant 
number and 
global 
performance 


P6-P13 
68.57— 
82.3596 
Male dataset 


Software and 
equipment 
Adobe 
Photoshop™ 
or 

GNU GIMP. 
Dennis 
Slice’s 
PhotoMatch 


superimposition (CAm3PS) 


Skull-face overlay 


Photoshop to resize images. 
Then, PhotoMatch to 
manipulate transparency, 
scaling, and rotation to 
match as many points as 
possible. 


Decision making 
Special signs: 
crowding, bro- 
ken nasal bones, 
asymmetry, etc. 


Observation 


Do not use the 
3D data but 
just the PM 
skull photos. 
Limited ori- 
entation and 
alignment 
capabilities. 


Eight different participants but all of them following the same methodology 
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Table 7.10 Overall accuracy of CFS grouped by level of experience of the participant 


Correct Ground Decision Decision (%) 
Participants | Sample | decisions truth Positive | Negative | Positive | Negative 
All 78.99% Positive 47.37 
Negative 84.20 
1 81.88% Positive 39.13 
Negative 86.09 
2 Global | 74.32% Positive 15 33 31.25 68.75 
Negative 43 205 17.34 82.66 
3 Global | 84.68% Positive 22 12 64.71 35.29 
Negative 20 155 11.43 88.57 
4 Global | 75.00% Positive 18 14 56.25 43.75 
Negative 34 126 21:25 78.75 
5 Global | 80.75% Positive 31 22 58.49 41.51 
Negative 39 225 14.77 85.23 


Table 7.11 Overall accuracy of CFS grouped by technological approach employed 


Tech. Correct | Ground |Decision Decision (%) 

Participants N. | approach | decision | truth Positive | Negative | Positive | Negative 

P2, P19 CAs3DS | 88.49% _ | Positive | 12 5 70.59 29.41 
Negative | 8 88 8.33 91.67 

P1, P3, P4, P5, | CAm3DS | 78.90% | Positive | 62 47 56.88 43.12 

P14, P15, P16, Negative |92 458 1673 | 83.27 

P17, P18, P20, 

P21, P22, P23 

P24, P25, P26 |CAmVS | 84.56% | Positive | 13 11 54.17 45.83 
Negative | 12 133 8.28 91.72 

P6, P7, P8, P9, |CAmPS | 74.06% | Positive | 12 24 33.33 66.67 

En P11, P12, Negative | 31 145 17.61 82.39 


7.3 Study on the Criteria Assessing Skull-Face 
Correspondence in Craniofacial Superimposition 


The MEPROCS consortium designed the current study, which aims to analyze the 
subjectivity and discriminative power of the different criteria (defined in the previous 
section of this chapter) for assessing the skull-face correspondence either proposed 
in the literature or by any of the MEPROCS partners. 


7.3.1 Experimental Study 


The dataset used in this study consisted of 18 different CFS problems, some of them 
composed of more than one image of the same subject, 24 SFOs in total. 
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Table 7.12 Marking lines used to analyze anatomical consistency 


Do you 
employ 
No. Criteria View it? 
Group Frontal 
1 Superimposition of the following marking lines (face-skull): | (F) - 
1.1 excanthion-excanthion (A) — ectocanthion-ectoconchion (A) | F 
Ectocanthion line 
1.2 glabella-gnathion (B) — glabella-gnathion (B”) F 
Frontal central line 
1.3 superciliary-superciliary (C) — superciliary-superciliary (C) | F 
Supraciliary line 
1,4 horizontal line at subnasal (D) — horizontal line at nasospinal | F 
(D) 


Subnasal line 
1.5 cheilion-cheilion (E) — occusal line/horizontal line at F 
stomion (E’) 
Cheilion line 


1.6 horizontal line at gnathion (H) — horizontal line at F 
gnathion (H’) 
Gnathion line 


137 endocanthion-cheilion (G) — entocanthion-caninion (G’) F 
[right] 
Entocanthion vertical line 


1.8 endocanthion-cheilion (G) — entocanthion-caninion (G^) [left] | F 
Entocanthion vertical line 


Skull 3D models were obtained from patients whose head has been scanned with 
a cone beam computed tomography (CBCT). 

The skull 3D models employed suffer from two different problems. Firstly, we 
only have part of the whole skull, from the jaw to the upper orbits, without including 
parietal, occipital, and part of the temporal areas. Secondly, the 3D model is, to a 
greater or lesser extent, noisy and may not be accurately represented. All those 
problems have the same origin: the use of CBCTs instead of CTs. High-resolution 
CTs together with photographs of the patient/volunteer were not accessible. How- 
ever, one benefit of the CBCT data is that the volunteer was upright rather than 
supine, as commonly recorded for CT scanning. 

Frontal and lateral photographs were taken of the same patients to create a set of 
positive cases, while other people with similar facial geometry were photographed in 
order to compose a set of negative cases. Nine of eighteen cases were positives and 
the other nine were negatives. Twelve of the photographs were lateral and twelve 
were frontal, half of them belonging to positive cases and the other half to negative 
cases. 

The participants were provided the same 24 SFOs as a single image with four 
different layers: facial photograph with and without landmarks and skull projection 
with and without landmarks. 
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Table 7.13 Landmarks used to evaluate soft tissue thickness 


Do you 
employ 
No. Criteria View it? 
Overall consistency of the facial outline and facial soft | Frontal (F)/ 
Group | tissue thickness at the following pair of homologous | Lateral-Oblique 


2 points (skull-face): (L-O) _ 
2.1 gnathion — menton F 
2.2. gnathion — menton L-O 
2.3 nasion — nasion L-O 
2.4 glabella — glabella L-O 
2.5 subespinale — subnasale L-O 
2.6 pogonion — pogonion L-O 
2.7 rhinion — rhinion L-O 
2.8 gonion — gonion F 
2.9 zygion — zygion F 
2.10 trichion — trichion L-O 
2.11 The minimal tissue thickness all along the contour is 


considered from the point of view of its symmetry by 
side for evaluating the match as acceptable. 


2.12 Ant lacrimal crest — medial canthus F/O 
2.13 Prosthion — supra-labiale F/L-O 
2.14 Alare — Alare F/L-O 
2.15 Gonion — gonion L 
2.16 Zygomaxilare — malare L 
2.17 Whitnall’s tubercle — lateral canthus F/L-O 
2.18 occlusion mid-incisors — stomion F/L-O 
2.19 porion — tragion L-O 
2.20 crista conchalis — supra-alare F/L-O 
2.21 intercanine distance (75%) — chelion F 
2.22 eyeball position — pupilare F 
2.23 supraorbitale — sag eyebrow F 
2.24 two tangents nasal — pronasale F/L-O 
2.25 Ist premolar/canine radiating line — chelion F/L-O 
2.26 mastoidale — subaurale L-O 
2.27 infraorbital foramen — chelion F/L-O 


For the sake of an objective analysis, it was important to focus the attention of the 
participants on the criteria for analyzing the skull and the face relationship only. This 
study should include both positive and negative SFOs. The procedure to obtain each 
type of SFO was different. 

For positive cases, optimal SFOs were achieved using the following procedure. 
The DICOM images resulting from the CBCT machine were automatically 
processed to obtain the corresponding 3D face and 3D skull models. After position- 
ing homologous points in both the 3D face model and the photograph, the former 
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Table 7.14 Consistency of the bony and facial outlines/morphological curves 


121 


Criteria 


View 


Do you 
employ 
it? 


Overall consistency of the bony and facial outlines/ 
morphological curves: 

The outline of the frontal bone follows the forehead 
outline. 

The skull and head height is similar (account for vari- 
ation in soft tissue and distortion in the perception 
created by presence of hair). 


Frontal(F)/ 
Lateral-Oblique 
(L-O) 

L-O 


L-O 


The width of the cranium fills forehead area of the face. 


The length of the skull from menton to bregma fits 
within the face. 


The lateral line of the zygomatic bone matches the 
outline of cheek. 


The chin outline is consistent with the mental outline. 


The gonial outline follows the outline of jaw angle. 


The outline of frontal process of the zygomatic bone 
can be aligned with the process seen in the face. The 
outline of the zygomatic arch can be fitted between the 
skull and the face. (This criterion is more easily appre- 
ciated in individuals with minimal soft tissue 
thickness). 


The arcus supraciliariaris follows supraorbital margin. 


3.10 


The temporal line is consistent with the outline of the 
forehead (Sometimes the temporal line cannot be 
distinguished). 


The outline of the face and the outline of the skull all 
along the contour follow each other maintaining sym- 
metrical flow by side. 


The outline of the nose in the face represented by shade 
distribution follows the outline of the nasal bone in the 
skull maintaining symmetrical flow by side. 


The asymmetries in the facial organs especially the nose 
reveal consistency with the asymmetries in the organs 
of the skull including the nasal structures. These include 
1. Asymmetries in the nasal area including the nasal 
bone, piriform aperture, and nasal spine 

2. Asymmetries in the zygomatic area, especially the 
extent of protrusion of the arch 

3. Asymmetries in the occlusal line caused by protrud- 
ing or overriding anterior dentition reflected as 
asymmetries in the corresponding part of the lip closure 
line 

4. Asymmetries in the gonia 


The arcus supraciliariaris follows supraorbital margin. 


(continued) 
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Table 7.14 (continued) 


Do you 
employ 
No. Criteria View it? 
Frontal(F)/ 
Group | Overall consistency of the bony and facial outlines/ Lateral-Oblique 
3 morphological curves: (L-O) _ 


3.15 The outline of the of the nasal bones follows the outline | L 
of the nose in the skull with minimal tissue thickness 
allowance 


3.16 The sagittal outline of the nasal cartilage is the mirror 
image of the contour of the pyriform aperture, relative 
to Line Nel passing through the rhinion point (1) and 
parallel to Line Ne2 joining the nasion(2) and the 
prostion (3) anthropometric points. LineNel splits the 
entire nasal cartilage into two symmetric mirrored 
halves: the protruding part of the nose cartilage is the 
mirror image of the cartilage filling the pyriform aper- 
ture of the cranium. 


3.17 Lateral nasal bulges. F 
3.18 Oblique line of the mandible. F 
3.19 Dental information (bony to bony consistency). F/L-O 


was automatically projected onto the latter so as to obtain an ideal match. Then, the 
parameters originating from that match between the 3D face model and the photo- 
graph were applied to the 3D skull model, resulting in an objective and accurate 
SFO. The latter superimposition is considered a ground-truth SFO. 

Figure 7.1 shows an overview of the whole ground-truth data creation process. 

For negative cases, the SFOs were performed using Face2Skull™ software. An 
expert was asked to obtain the best possible SFO and to judge the skull-face 
relationship without being informed of the actual negative relationship to avoid 
biasing the SFO process. 

For the criteria assessment study, 37 forensic experts were asked to indicate 
which specific criteria they are going to use for evaluating the 24 skull-face relation- 
ships. The criteria are organized in four groups according to the family criteria: lines 
(group 1), landmarks-soft tissue (group 2), outlines (group 3), and positional rela- 
tionship (group 4). Group 1 is composed of 28 criteria, group 2 has 27 criteria, group 
3 is a set of 19 criteria, and group 4 is made up of 21 criteria. 

Forensic experts were asked to evaluate the skull-face correspondence following 
a systematic approach. For each SFO, the degree of consistency of all the criteria 
previously selected was indicated using the following values: 0: not evaluable, 1: not 
match, 2: poor match, 3: doubtful match, 4: good match and 5: perfect match. 

In order to avoid personal interpretations, MEPROCS partners assigned in 
advance (before giving the instructions to the participants) the value O to those 
criteria they considered unable to be visually checked due to the noisy nature of the 
image, the absence of the bony part, or the pose of the photograph. That was carried 
out for each single SFO case. 
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Table 7.15 Positional relationship analyzed to assess anatomical consistency 
Do you 
employ 
No. Criteria View it? 
Frontal (F)/ 
Group | Overall consistency positional relationships between Lateral-Oblique 
4 the skull and face: (L-O) _ 
4.1 The prosthion lies posterior to the anterior edge of the | F 
upper lip. The occlusal and the lip closure line are 
consistent. 
4.2 The lateral angle of the eye lies within the lateral wall | L-O 
of the orbit. 
4.3 The lateral orbital margin at the Whinall’s turbercle L-O 
matches or approximates the of the ectocathionposition 
44 The width and height of piriform aperture lie within the | F 
borders of the nose. 
4.5 The stomion lies at the central incisors (at the L-O 
occusal line). 
4.6 The lateral margin of the piriform aperture matches or | L-O 
approximates the alare. 
4.7 The stomion lies at the central incisors (incisal margin | F 
of the upper incisors). 
4.8 The nasion is higher than the nasal root. L-O 
4.9 The prosthion lies posterior to the anterior edge of the | L-O 
upper lip. The occlusal and the lip closure line are 
consistent. 
4.10 The medial margin of orbit aligns and superimposes F 
with the endocanthion. 
4.11 The nasion is higher than the nasal root. F 
4.12 The Whitnall’s tubercle aligns with the ectochantus on | F 
the horizontal plane and ,vertically, the ectochantus lies 
medial to the tubercle. The orbital width is consistent 
with the eye-slit width. 
4.13 The chelion lies between the canine and the first pre- | F 
molar (at the occusal line). 
4.14 The porion aligns just posterior to the tragus, slightly | L-O 
inferior to the crus of the helix. 
4.15 The lower margin of piriform aperture matches the L-O 
subnasale. 
4.16 The eyebrow generally follows the upper edge of the | F 
orbit over the medial two-thirds. At lateral superior 
one-third of the orbit, the eyebrow continues horizon- 
tally as the orbital rim begins to curve inferiorly. 
4.17 The external auditory meatus opening lies medial to the | F 
tragus of the ear. (Place a projecting marker at the ear 
canal to assess this criterion more easily). 
4.18 The chelion lies between the canine and the first pre- | L-O 


molar (at the occusal line). 


(continued) 
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Table 7.15 (continued) 


Do you 
employ 
No. Criteria View it? 


Frontal (F)/ 
Group | Overall consistency positional relationships between Lateral-Oblique 


4 the skull and face: (L-O) _ 
4.19 The anterior nasal spine lies posterior to the base of the | L-O 

nose near the most posterior portion of the lateral septal 

cartilage. 


4.20 Gonial flare in the skull and the postero-lateral jaw L-O 
angle outline in the face. 
4.21 Gonial flare in the skull and the postero-lateral jaw F 
prominence in the face. 


CBCT automatic 
Data acquisition segmentation 


= wy 


facial 3D model skull 3D model 


i - Y ç 


Apply exactly the same 
[odor iq previous 3D-2D registration: 
tart — projection, rotation, translation, 
and scaling and scaling 
E 


Fig. 7.1 Overview of the ground-truth data creation process 


Finally, for each SFO case (and also for each CFS case when it implies more than 
one SFO), participants were asked to indicate the final identification decision 
according to the following scale: —3: strong support of not being the same 
person,—2: moderate support of not being the same person,—1: limited support of 
not being the same person, 0: not determined, +1: limited support of being the same 
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person, +2: moderate support of being the same person, and +3: strong support of 
being the same person. Therefore, the dataset is composed by: 

The forensic expert, the specific SFO case and its state (positive or negative), the 
photograph of the SFO case (frontal or lateral pose), the criteria used by the expert in 
order to evaluate the corresponding SFO case, the family of the criteria, the degree of 
consistency of these latter criteria given by the expert (0: not evaluable, 1: not match, 
2: poor match, 3: doubtful match, 4: good match and 5: perfect match), and the 
decision of the expert for the corresponding case (—3: strong support of not being the 
same person, —2: moderate support of not being the same person, —1: limited 
support of not being the same person, 0: not determined, +1: limited support of 
being the same person, +2: moderate support of being the same person, and +3: 
strong support of being the same person). 


7.3.1.1 Data Analysis 


We have developed three studies with the following characteristics: 
1. According to the data employed: 


(a) With all the data. 

(b) Filtering (removing) the experts with a proficiency lower or equal than 0.5. 

(c) Filtering (removing) the scenarios (SFO cases) with higher standard deviation 
(fourth quartile). 


2. According to the view of the photographs: frontal versus lateral poses 
3. According to the family of criteria: lines, landmarks-soft tissue, outlines, and 
positional relationship 


The statistical analysis developed relied on several concepts that are introduced 
below together with an example: 


— Cases with decision (CD): the cases in which the expert’s decision is different 
from 0 (not undetermined) 

— Expert proficiency: the proportion of cases with decision in which the expert 
evaluated the status of the case correctly 


_TP4TN 


EP s 
CD 


(7.1) 


where TP is the number of positive cases with a positive decision and TN is the 
number of negative cases with a negative decision, and CD is the number of cases 
with decision 


7.3.1.2 Correlation Between Two Variables 


Before computing which are the most relevant criteria, we have calculated the 
correlation between the status of the identification case and the decision of the 
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forensic expert (correlation-based expert proficiency). Furthermore, we have also 
estimated the correlation between the value of a criterion and the status of a case 
(criterion correlation with ground truth). That correlation assesses the tendency of a 
criterion to have higher values on positive cases and lower values on negative ones. 

Correlation is a statistical technique that can show whether and how strongly pairs 
of variables are related. The Pearson correlation coefficient is the most widely used. 
It measures the strength of the linear relationship between normally distributed 
variables. When the variables are not normally distributed or the relationship 
between the variables is not linear, it may be more appropriate to use the Spearman 
rank correlation method. Spearman’s coefficient, like any correlation calculation, is 
appropriate for both continuous and discrete variables, including ordinal variables 
(Wilkinson 2006). Due to the nature of our dataset, we have applied the Spearman 
rank correlation method. 

The Spearman correlation coefficient is defined as the Pearson correlation coef- 
ficient p between the ranked variables. For a sample of size n, the n raw scores X;,Y; 
are converted to ranks x;, y;, and p is computed from 


2 
p=1- ee, (7.2) 


where d; = x; — y; is the difference between ranks. Identical values (rank ties or value 
duplicates) are assigned a rank equal to the average of their positions in the 
ascending order the values. 

The sign of the Spearman correlation indicates the direction of association 
between X (the independent variable) and Y (the dependent variable). If Y tends to 
increase when X increases, the Spearman correlation coefficient is positive. If Y tends 
to decrease when X increases, the Spearman correlation coefficient is negative. A 
Spearman correlation of zero indicates that there is no tendency for Y to either 
increase or decrease when X increases. The Spearman correlation increases in 
magnitude as X and Y become closer to being perfect monotone functions of each 
other. When X and Y are perfectly monotonically related, the Spearman correlation 
coefficient becomes 1. 

We have performed the Spearman correlation with a statistical test in order to 
estimate the significance of the results. The considered level of statistical signifi- 
cance was 0.05. 

For the correlation-based expert proficiency, the specific aim was to test the null 
hypothesis (Ho) stating that the correlation between the decision of the expert and the 
status of the case are not correlated. In the case of the criterion correlation with the 
ground truth, the goal was to test the null hypothesis (Ho) stating that the correlation 
between the value of the criterion and the status of the case are not correlated. 

As complementary studies, we have added the following analyses: 


— Criterion weighted correlation with ground truth: same as the correlation with 
ground truth, except that the correlation coefficient associated with each expert is 
weighted according to his proficiency. 
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— Criterion variability: it is computed as the mean standard deviation of the criterion 
evaluation over the same case. It aims to assess the subjectivity of a criterion. 


7.3.1.3 Linear Regression 


Correlation makes no a priori assumption as to whether one variable is dependent on 
the other(s) and is not concerned with the relationship between variables; instead, it 
gives an estimate as to the degree of association between the variables. In fact, 
correlation analysis tests for interdependence of the variables. 

AS regression attempts to describe the dependence of a variable on one (or more) 
explanatory variables, it implicitly assumes that there is a one-way causal effect from 
the explanatory variable(s) to the response variable, regardless of whether the path of 
effect is direct or indirect. 

Therefore, we have complemented the latter correlation analysis with a linear 
regression test. 

Linear regression attempts to model the relationship between two variables by 
fitting a linear equation to observed data. One variable is considered to be an 
explanatory variable, and the other is considered to be a dependent variable. This 
functional relationship may then be formally stated as an equation, with associated 
statistical values that describe how well this equation fits the data. 

A linear regression line has an equation of the form Y = a + bX, where X is the 
explanatory variable and Y is the dependent variable. The slope of the line is b, and 
a is the intercept (the value of y when x = 0). 

The most common method for fitting a regression line is the method of least- 
squares. This method calculates the best-fitting line for the observed data by mini- 
mizing the sum of the squares of the vertical deviations from each data point to the 
line (if a point lies on the fitted line exactly, then its vertical deviation is 0). Because 
the deviations are first squared, then summed, there are no cancellations between 
positive and negative values. 

We have performed the linear regression test in order to estimate if the value of a 
criterion depends on the status of the case. The goal is to test the null hypothesis (Ho) 
stating that the value of a criterion has not an influence in the status of the case. 


7.3.2 Results 


With the aim of providing a feasible forum of discussion we have focused the 
analysis on only one scenario, the 1.a, that is, all the data (participants and CFS 
cases) are considered at the same time. Additionally, in some parts of the document, 
we also refer to the second scenario where the data was divided into two different 
sets according to the view of photograph: frontal and lateral. 

Table 7.16 depicts the proportion of cases with decision in which the expert 
evaluates correctly status of the case (proficiency) and the number of cases given by 
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a Con with "t Forensic expert Proficiency Cases with decision 

ecision and simple expe: A sa DG =A 

sponses DUM Fl 0.62 0.96 
F2 0.58 1.00 
F3 0.58 0.83 
F4 0.50 1.00 
FS 0.54 0.79 
F6 0.38 0.96 
F7 0.62 1.00 
F8 0.46 0.96 
F9 0.42 0.96 
F10 0.42 0.83 
F11 0.48 0.96 
F12 0.62 1.00 
F13 0.54 0.83 
F14 0.50 0.92 
F15 0.58 1.00 
F16 0.67 1.00 
F17 0.67 1.00 
F18 0.46 0.88 
F19 0.54 1.00 
F20 0.58 0.92 
F21 0.67 0.96 
F22 0.67 0.88 
F23 0.75 1.00 
F24 0.50 1.00 
F25 0.50 0.88 
F26 0.42 0.83 
F27 0.67 1.00 
F28 0.42 0.96 
F29 0.50 1.00 
F30 0.62 1.00 
F31 0.75 0.96 
F32 0.46 1.00 
F33 0.62 1.00 
F34 0.67 0.92 
F35 0.54 0.92 
F36 0.54 0.75 
F37 0.58 1.00 


the expert with a decision different of the zero value. The average performance was 
poor. In the best case, the rate is just 75% (only two experts). A percentage of 
37 (14 experts) of the participants did not overcome 50% of correct answers. The 
performance is thus worse than previous studies that also involved the SFO stage 
(Yoshino et al. 1995; Gordon and Steyn 2012; Jayaprakash et al. 2001; Martin and 
Saller 1957). Possible explanations for this low performance rates are 


73 Study on the Criteria Assessing Skull-Face Correspondence in... 129 


— The absence of a complete cranium. 

— The quality of some 3D models, which in some cases present noisy parts and 
artifacts. 

— The materials given to the participants do not include the 3D skull models but just 
a projection on a 2D plane. 

— The isolation of the decision-making stage given an SFO. 


While the negative influence of the first three is quite evident, the fourth is not 
clear at all. It is the first time that such a study where SFOs are given at hand is 
developed. The process of overlaying the skull over the face also involves a 
continuous comparison of the skull-face relationship that is not performed within 
this study. 

Table 7.17 shows the results of the Spearman test in order to calculate the 
correlation between the status of the identification case and the decision of the 
forensic expert. The proficiency in Table 7.16 corresponds to the Spearman corre- 
lation coefficient. We observe that seven experts achieve a significant correlation 
between their decision and the status of the case. F20, F21, F22, F23, F31, F34, and 
F36 have a Spearman positive correlation >0 with a p-value<0.05. In the rest of 
cases, we cannot reject the null hypothesis of correlation between the decision of the 
expert and the status of the case; that is, we cannot assert that the decision of the 
expert is correlated with the status of the case with a confidence level of 95%. 

Table 7.18 shows the number of times a criterion has been evaluated over the total 
number of evaluations (each participant for each SFO case), “Usage C.” It also 
shows the percentage of participants that employed a criterion at least once, “Usage 
P.” Both statistics are depicted for all the cases (“All”), only frontal cases (“Fron- 
tal”), and only lateral/oblique cases (“Lateral”). Those criteria that were employed in 
less than the 10% of the cases were removed from the corresponding study. In 
particular, criteria G2.10, G2.26, G3.2, and G3.4 do not reach the required 10% of 
usage irrespective of the dataset considered (all, only frontal, or only lateral). Criteria 
that were employed by less than 30% of the participants were also not considered in 
the corresponding study. The motivation for avoiding these criteria is related to the 
lack of significance of reduced samples of data. 

Table 7.19 presents the results of the correlation between the value of a criterion 
and the status of the case with a p-value <0.05, that is, statistically significant results. 
That correlation assesses the tendency of a criterion to have higher values on positive 
cases and lower values on negative ones. 

Eight experts obtained a correlation between one or more criteria and the status of 
the case with a confidence level of 95%. Hence, we can affirm that the use of some 
criteria is significantly correlated with the status of the case; that is, some criteria 
have higher values on positive cases and lower values in negative ones. In most 
cases, we obtain a positive correlation: when the degree of a criterion increases, the 
status of the case tends to a positive identification. 

The performed regression analysis computes the independence between the value 
of a criterion and the status of the case. 
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Table 7.17 Spearman tests, Forensic expert Correlation coefficient p-Value 
correlation-based expert EEE  —_————- o ————————A >. 
proficiency, cases with E 0.29 0.17 
p-values «0.05 in bold F2 0.21 0.33 
F3 0.32 0.13 
FA 0.21 0.33 
F5 0.33 0.11 
F6 —0.07 0.75 
F7 0.03 0.91 
F8 —0.08 0.71 
F9 —0.10 0.64 
F10 0.13 0.53 
F11 0.24 0.27 
F12 0.26 0.21 
FI | | (os O 
F14 0.10 0.63 
F15 0.30 0.15 
F16 0.38 0.07 
F17 0.34 0.11 
FI8B = — | 02 | 1|023 
F19 0.22 0.31 
F20 0.61 0.00 
F21 0.45 0.03 
F22 0.52 0.01 
F23 0.49 0.01 
F24 0.10 0.63 
F25 0.23 0.29 
F26 —0.03 0.88 
F27 0.21 0.33 
F28 —0.22 0.30 
F29 —0.05 0.81 
F30 0.27 0.21 
F31 0.54 0.01 
F32 —0.30 0.15 
sa 
F34 0.50 0.01 
F35 0.30 0.16 
F36 0.40 0.05 
F37 0.13 0.54 


Table 7.20 depicts the results that have a p-value <0.05, that is, those cases that 
reject the null hypothesis. Thus, shows the criteria that have significant influence on 
the status of the case. 

Nine experts obtain a dependency between one or more criteria and the status of 
the case with a confidence level of 95%. Hence, we can affirm that the use of some 
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Table 7.19 Spearman test, correlation statistically significant between criterion and the status of 
the case 


Forensic expert Criterion Correlation coefficient p-Value 
F3 G2.9 0.48 0.02 
F3 G2.14 0.51 0.01 
F4 G1.4 0.43 0.03 
F4 G3.18 0.49 0.01 
F7 G2.18 0.41 0.04 
F11 G3.12 0.47 0.02 
F11 G3.13 0.44 0.03 
F11 G3.15 0.65 0.00 
F16 G1.2 0.42 0.03 
F16 G1.5 0.41 0.04 
F16 G1.8 0.52 0.00 
F16 G2.3 0.49 0.01 
F16 G2.6 0.52 0.00 
F16 G2.14 0.56 0.00 
F16 G3.6 0.46 0.02 
F16 G4.14 0.50 0.01 
F19 G2.8 0.47 0.02 
F19 G3.7 0.43 0.03 
F19 G4.15 0.50 0.01 
F21 G3.19 0.41 0.04 
F30 G3.18 0.48 0.01 


criteria is significantly dependent on the status of the case; that is, some criteria have 
higher values on positive cases and lower values in negative ones. 

It is important to note that we have achieved similar results in the correlation and 
regression tests (Tables 7.19 and 7.20). The criteria that present the most influence in 
the status of the case are G2.14, G2.17, G2.18, and G3.12. 

A boxplot with the expert's assessment across the scenarios is depicted in 
Fig. 7.2. This boxplot shows the significant variability within each of the expert's 
responses. In general, both negative and positive cases have similar performance 
rates although a lower variability resulted in the evaluation of the positive ones. 
While there are only two negative cases (4-2 and 11-1) where most of the partici- 
pants (77596) made a correct evaluation, there are four positive cases with a similar 
successful evaluation (3-1, 7-1, 13-1, and 18-1). Looking at the median values (black 
horizontal line inside the boxes), there are three negative cases that were incorrectly 
assessed by most of the participants: SFO cases 4-1, 15-1, and 16-1. The median 
values of the other three cases (8-1, 10-1, and 17-1) fall in the undetermined category 
(value 0). Similarly, there are three positive cases that were incorrectly evaluated by 
most of the participants: SFO cases 5-1, 5-2, and 12-1. For all these cases, 7596 of the 
participants did not make the correct identification. Differences were not observed 
between the evaluations of lateral versus frontal views. 
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Beg Pea ido elas Forensic expert Criterion F value p-Value 

e saan man Seni ra ae 2 0.02 

and the status of the case F3 G2.14 7.53 0.01 
F4 G1.4 5.00 0.03 
F4 G3.18 6.66 0.01 
F7 G2.18 5.96 0.02 
F11 G3.12 4.62 0.04 
F11 G3.15 11.56 0.00 
F11 G4.7 4.10 0.05 
F16 G1.5 4.66 0.04 
F16 G1.8 7.97 0.00 
F16 G2.3 6.82 0.01 
F16 G2.6 7.97 0.00 
F16 G2.14 8.00 0.00 
F16 G3.6 4.23 0.05 
F16 G3.12 4.45 0.04 
F16 G4.14 7.61 0.01 
F18 G4.3 4.22 0.05 
F19 G2.8 5.03 0.03 
F19 G2.17 4.50 0.04 
F19 G2.18 4.14 0.05 
F19 G4.15 5.76 0.02 
F21 G3.19 5.55 0.02 
F23 G2.11 4.00 0.05 
F30 G3.18 7.48 0.01 
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Fig. 7.2 Statistical representation of the expert’s assessment for each (negative and positive) SFO 
case. Expert decisions (between —3 and +3) on the y-axis and SFO cases on the x-axis. F and L, in 
brackets after the number of the case, indicate frontal and lateral view cases, respectively 
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The subjectivity was measured as the standard deviation of the evaluations 
(Table 7.21). The standard deviation was computed on each case, and then the 
values were averaged. The ranges of values for the criteria are within the interval 
[1, 5] and thus can conclude that there is a significant distribution in the evaluations 
by the different participants with standard deviations ranging from 0.85 to 1.31. 

A primary goal for the current study is to provide forensic anthropologists with 
the means (objective data) to select a set of criteria, or to establish a ranked order of 


Table 7.21 Criterion subjectivity 


Criterion Mean standard deviation Criterion Mean standard deviation 
G2.20 0.85 G3.16 1.12 
G3.10 0.87 G2.12 1.12 
G3.1 0.92 G2.17 1.12 
G1.5 0.92 G2.14 1.12 
G1.8 0.93 G3.11 1.14 
G3.18 0.97 G3.9 1.14 
G1.3 0.97 G4.12 1.14 
G2.19 0.97 G2.3 1.14 
G2.24 1.01 G3.14 1.14 
G1.2 1.02 G2.15 1.14 
G2.16 1.02 G4.20 1.14 
G2.23 1.03 G3.6 1.15 
G4.19 1.03 G2.22 1.15 
G1.7 1.04 G3.8 1.15 
G2.25 1.05 G4.4 1.15 
G4.10 1.06 G4.6 1.15 
G1.6 1.07 G1.1 1.17 
G2.21 1.07 G2.11 1.17 
G2.9 1.07 G2.5 1.18 
G2.27 1.08 G4.15 1.19 
G4.13 1.10 G4.8 1.19 
G2.7 1.10 G3.5 1.19 
G2.18 1.10 G4.3 1.19 
G2.8 1.10 G4.16 1.19 
G3.7 1.10 G4.2 1.20 
G1.4 1.10 G2.1 1.20 
G4.5 1.10 G4.18 1.21 
G4.14 1.10 G3.19 1.21 
G2.4 1.11 G4.11 1.21 
G4.1 1.11 G3.13 1.21 
G3.3 1.11 G32.2 1.23 
G4.21 1.11 G3.12 1.23 
G2.13 1.11 G3.15 1.26 
G4.9 1.11 G2.6 1.31 
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Fig. 7.3 Scatter plot including all the criteria under study spatially distributed according to their 
subjectivity (x-axis) and discriminative power (y-axis) 


preference, with the most discriminative power and easy to evaluate traits. Figure 7.4 
visualizes the standard deviation (related to the ease of objective assessment) and the 
correlation (related to the discriminatory power criterion). 

Three red lines split five groups of criteria with one group split into two separate 
groups with have six groups in total, which represent the best criteria and the highest 
discriminatory power with the lowest variability in the top left corner (G3.1 and 
G4.14). Below this region, the criteria that can be considered easy to evaluate, which 
are important criteria in terms of discriminative power with high correlation values 
(G3.10, G2.19, G1.8, and G2.22). In the top right corner, the criteria with almost the 
highest discriminative power with highest variance are grouped (G3.19).The largest 
area, more or less in the center of the Fig. 7.3, shows the majority of the criteria that in 
general are not significantly different (G4.12, G4.1, G2.9, G2.16, G4.7, G1.3, G1.5, 
and G2.21). Within this region, surrounded by a red-colored circle, we have identified 
a fifth group composed by criteria with a good trade-off between subjectivity and 
discriminative power (G3.16, G1.7,G2.4,andG2.23).Finally, the right bottom corner 
groups the least useful criteria with regards to their subjectivity and do not discrim- 
inate between face and skull (G1.2, G2.1, G4.11, G1.6, G2.15, and G2.13). 

Figure 7.4 depicts the differences between the frontal views that cluster specific 
criteria according to the pose of the person's face within the photograph. 

For the frontal cases, five groups can be differentiated. At the top scatter plot, the 
criteria with highest discriminative power (G3.19) are observed. Below this group, 
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Fig. 7.4 Criterion according to the frontal pose of the person's face in the photograph 


the group with the criteria with a good trade-off between subjectivity and discrim- 
inative power is observed (G4.20, G4.5, G1.7, G2.18, GI.8, G4.2, G4.7, G4.1, 
G2.22, and G2.23). On the left side of the scatter plot, easy to evaluate criterion is 
depicted (G3.10) with the least amount of variability. In addition, it is an important 
criterion in terms of discriminative power with high correlation values. In the center 
of the scatter plot, the majority of the criteria are found showing the least amount of 
difference among them. Finally, the right bottom region groups the least useful 
criteria with the highest subjectivity and that cannot be used to discriminate between 
face and skull (G1.2, G2.1, G1.6, G4.18, G4.11, G2.3, G3.6, GI.1, G2.8, G3.18, 
G1.4, G2.6, and G4.10). 

Figure 7.5 depicts the differences between the lateral views that cluster specific 
criteria according to the pose of the person's face within the photograph. 

For the lateral cases, although they can be grouped into eight separate groups, the 
two groups in the center part (between correlation values of 0 and 1.2) are considered 
as part of the same group of criteria with almost no discriminatory power. On the top 
left corner, the best criteria are represented (G3.1and G4.17), which also have the 
greatest discriminatory power and least variability. At the top right corner, encloses 
the group with the greatest discriminatory power and the greatest variability (G4.14 
and G3.19). Below group, a group identified (criteria G2.4, G3.11, G2.9, G1.1, 
G4.10, G2.12, and G2.19) as still important correlation with the identification 
decisions and a significant variability is shown. Similarly, criterion G3.18 holds 
important discriminatory power but has a significantly lower variability. As in the 
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Fig. 7.5 Criteria according to the lateral pose of the person's face in the photograph 


other two sections, the central part of the scatter plot contains the majority of the 
criteria, which do not hold significant correlation values. Finally, the bottom right 
part of the scatter plot contains the criteria with the greatest subjectivity and that 
cannot discriminate between face and skull (G4.15, G3.9, G2.13, G4.11, and G4.16). 
Note that G3.14 refers to the same anatomical correspondence criterion as G3.9 but 
analyzed on different image views. 
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Chapter 8 Y 
MEPROCS Craniofacial Superimposition — 
Framework 


8.1 Introduction 


Of the various tanatological identification techniques, CFS is considered a contro- 
versial technique within the scientific community. The lack of unified working 
protocols among practitioners as well as the absence of commonly accepted stan- 
dards in the application of the technique have led to a lack of consensus regarding the 
reliability of CES. 

In general, experts in the field tend to apply their own approach to the problem, 
based on the technology available in their laboratory. For instance, when adjusting 
the scale of skull and face images, some investigators focus on a specific pair of 
homologous landmarks, others rely on a more global adjustment of the facial and 
skull contours or they look for a morphological consistency. Some experts have 
modeled the latter problem using a mathematical formulation that can be automat- 
ically solved using optimization methods. 

Craniofacial superimposition evolved as new technology, available to practi- 
tioners, based on previously laid foundations (Wilkinson 2004; Austin-Smith and 
Maples 1994). The variety of supporting technological advances involved a large 
number of very diverse approaches, that is, photo CFS, video, computer-aided photo 
CFS, computer-aided video CFS, computer-aided 3D-2D CFS, as well as manual, 
semiautomatic, and automatic approaches, all of which can be found in the literature 
(Damas et al. 2011; Yoshino et al. 1995). 

Furthermore, there are different anatomical criteria employed to assess goodness of fit: 
contours, lines, proportions, landmarks and soft tissue depth studies of points, morphol- 
ogy, asymmetries, positional relationships, etc. The differences are not only in the set of 
criteria used but also on the weight given to them, while evaluating the skull-face 
relationship. Finally, each expert has her/his own decision scale, with different numbers 
of labels, different names and meanings, and different criteria to move along the scale. 

As stated in the introductory chapter of this book, the aim of the MEPROCS’ 
project was to propose a common framework, avoiding particular assumptions that 


© The Author(s) 2020 139 
S. Damas et al., Handbook on Craniofacial Superimposition, 
https://doi.org/10.1007/978-3-319-11137-7 8 


140 8 MEPROCS Craniofacial Superimposition Framework 


could bias the process, allowing the extensive application of the CFS technique in 
practical forensic identification scenarios. 

To achieve this purpose, some of the most representative experts in craniofacial 
identification Joined in a series of discussions intended to identify and agree on the 
most important issues to be considered in the proper implementation of the CFS 
technique. Three experimental studies, designed to obtain objective data that sup- 
ports and guides these discussions, were carried out during the project. 


8.2 Study of the Most Important Issues for a Proper 
Implementation of the Craniofacial Superimposition 
Technique 


The first multiple-laboratory validation study on CFS included 26 participants from 
17 different forensic and academic institutions from all over the world. The partic- 
ipants were asked to consider 14 identification scenarios, including a total of 60 CFS 
problems, of one-to-many and one-to-one cases, divided into female and male 
substudies. Each participant followed her/his own methodology, employing her/his 
particular technological means. 

Once the study finished, all MEPROCS partners were provided with a detailed 
report summarizing the results of the study together with the individual results of 
each participant. This included a summary of the methodology followed by each 
participant, global performance together with false/true positive/negative rates, 
performance on male and female datasets separately and integrated, performance 
grouped by level of experience and by technological approach, and all superimpo- 
sition images and skull-face relationship reports grouped by case (only in those cases 
with a higher variability and those with the worst performance). 

A second reliability study, designed to analyze the subjectivity and discrimina- 
tory power of the different criteria for assessing the skull-face correspondence, was 
conducted. Thirty-seven participants with various levels of competency in CFS were 
asked to analyze 18 CFS problems, some of them composed of more than one image 
of the same subject, totaling 24 superimpositions. For each pair of skull and face 
photographs, the investigator was provided with an optimal or near-optimal SFO, 
achieved by the superimposition of a 3D face model over the facial photograph of the 
subject. The data provided was obtained from CBCT of different subjects and face 
photographs of the subjects. Informed consent from the volunteers and confidenti- 
ality documents from the investigators were signed, prior to the study. 

First of all, participants were asked to indicate which specific criteria they were 
going to use for evaluating the skull-face relationships (see the appendices for a 
detailed list of the criteria provided). Then, they were asked to evaluate the skull-face 
correspondence following a systematic approach. For each SFO, the degree of 
consistency of all the criteria previously selected were indicated using the following 
values: 0—not evaluable, 1—no match, 2—poor match, 3—doubtful match, 4— 
good match, 5—perfect match. 
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In order to avoid personal interpretations, MEPROCS partners assigned in 
advance (before giving the instructions to the participants) the value O to those 
criteria they considered unable to be visually checked due to the noisy nature of the 
image, the absence of the bony part, or the pose of the photograph. This was carried 
out for each single SFO case. 

Finally, for each SFO case (and also for each CFS case, which implies more than 
one SFO), participants were asked to indicate the final identification decision according 
to the following scale: —3, strong support of not being the same person; —2, moderate 
support of not being the same person; — 1, limited support of not being the same person; 
0, undetermined; +1, limited support of being the same person; +2, moderate support of 
being the same person; +3, strong support of being the same person. 

As in the first study, once this second study was completed, all partners were 
provided with an in-depth statistical analysis of the data. Three different areas of 
analysis were generated based on the following characteristics: 


1. According to the data employed 

2. According to the view of the photographs: frontal vs. lateral 

3. According to the family of criteria: lines, landmarks-soft tissue, outlines, and 
positional relationship 


Due to similar results and in order to narrow the discussion, the consortium 
decided to focus on the second statistical analysis. 

Based on the conclusions of these discussions, and on validation studies over a 
significant number of cases (to get a solid picture of the reliability of CFS), the 
experts wrote up the current manuscript, which could be considered the first standard 
in the field, including good and bad practices, sources of error and uncertainties, 
technological requirements and desirable features, and finally a common scale for 
the craniofacial matching evaluation. 

An in-depth analysis of all the resulting superimposition images in correlation 
with the respective analysis of the skull-face relationship identified the following 
main sources of errors. 


8.2.1 Main Sources of Error in Craniofacial Superimposition 


1. Skull-face overlay and, in particular, the adequate perspective of the skull. For 
example, most of the software programs employed for this task do not allow 
alteration of the projection, but “Just” the orientation and scaling. In many cases, 
it involves an error-prone trial and error process. Orientation + scaling + 
perspective. 

2. The digital articulation of the mandible and cranium after scanning can 
introduce errors. With no access to the occlusion as it was in life, the mandible 
may have been placed in an incorrect position with respect to the cranium. 

. The attachment of the mandible to the cranium. 

4. The replication of the AM position of the mandible. 


W 
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5. The incomplete preservation and post-mortem reassembly of the skull. For 
example, the incorrect positioning of teeth in the sockets. 

6. The inaccurate 3D skull acquisition (or segmentation in case of CT scanner), 
precision below 1 mm, and/or specific features not properly scanned 
(or segmented). The latter was recorded at the nasal region, the teeth, and the 
orbits. Presence of artifacts. 

7. The aspect ratio of the photograph. 

8. The unknown origin of the AM photograph. 

9. The post-mortem skull damage. 


All the latter issues are considered sources of errors; thus, they should be considered 
in order to avoid accumulating and propagating errors during the CFS process. In 
addition, there are several issues that can negatively affect conclusions based on 
CFS, but, unlike sources of errors, they cannot be avoided. In contrast, they have to 
be considered an inherent part of the process, and thus, they have to be properly 
modeled and incorporated in the decision-making process. We have referred to these 
issues as sources of uncertainty, since, contrary to complete and precise knowledge, 
they represent partial, incomplete, imprecise, and/or vague information. 


6.2.2 Main Sources of Uncertainty in Craniofacial 
Superimposition 


1. Cephalometric landmark location uncertainty: this is related to the extremely 
difficult task of locating the points in a completely reproducible manner. The 
variability may arise for reasons such as 


(a) Variation in the distribution of shadows that is dependent on the lighting 
conditions during photography. 

(b) Unsuitable camera focusing, especially when the plane of focus is too shallow 
and hence the critical features are not sharp. 

(c) Poor image quality, that is, low resolution. 

(d) Face posture in the photograph, that is, facial expression and angle of view of 
the face (lateral, frontal, or oblique). 

(e) Occlusion of part or all of a landmark. 

(f) Imprecise definition of some anthropometric landmarks could be due to either 
ambiguous terminology or because it is poorly defined in an anatomical sense. 


2. Landmark matching uncertainty: It refers to the imprecision that is involved in 
the matching of two sets of potentially corresponding landmarks derived from 
two different objects; a face and a skull. 


(a) The correspondence between facial and cranial anthropometric landmarks is 
not always symmetrical and perpendicular to the skin surface and to the 
underlying bone. 

(b) The facial soft tissue depth varies for each cephalometric landmark, as well as 
for different populations (based on age, race, and sex). 
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(c) Considerations of how the distances between potentially corresponding land- 
marks are affected by the posture and facial expression in the image have to 
be taken into account. 

(d) There are many studies describing the uncertainty related to differing soft 
tissue depths for different populations, but almost none of them considered 
the projection of those distances onto the AM photo used in the comparison. 


. Skull-face overlay uncertainty: There is no precisely quantifiable way of deter- 


mining when an accurate superimposition has been achieved. 


. There are many unknown (and/or uncertain) parameters involved in the replica- 


tion of the original photographic conditions used to produce the image employed 
in the comparison. 


. Morphological criteria are subjective or difficult to quantify. 
. The amount of morphological criteria that have to be satisfied for a positive 


identification. 


. The effects of dental changes detected from examination of the AM photographs 


used for comparison with the skull, as well as their accurate interpretation. 


. Age-related changes: The craniofacial morphology of children needs to be 


investigated and documented more comprehensively before comparisons 
between images taken at different times during childhood can be compared. 


The following “best practices" and "practices that should be avoided" represent 
some guidelines to minimize or avoid the main sources of error, as well as, to deal 
with the sources of uncertainty that are concomitant to the application of CFS. 


These steps should be viewed as recommendations and under no circumstances 


should they be perceived as requirements to accomplish a “valid” result. The authors 
are fully aware that the circumstances of each case are to be taken into consideration, 
when evaluating the results of identification based upon CFS. 


8.2.3 Best Practices in Craniofacial Superimposition 


Ne 


Un + Ww 


. Use the real skull to confirm correct fit of the mandible with the cranium. 
. Use the real skull and mandible to articulate the dentition and establish centric 


occlusion. 


. Reproduce the position of the mandible as displayed in the AM photograph. 
. Locate and mark landmarks on the skull before scanning. 
. Use multiple (more than one) AM photos or frames taken from video with the 


candidate in different poses, as far as they provide new information, for exam- 
ple, more anatomical information provided by additional viewpoints. 


. Use AM photographs of good quality. For optimal examination, in full frontal 


images, the resolution of the face image should be at least 180 pixels 
corresponding to the width of the head, or roughly 90 pixels between the pupils 
of the eyes. (ISO International Standard ISO/IECJTC 1/SC 37 N506). 


. Avoid images with obscuring objects. For example, spectacles and beards. 
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8. During the growth period of children’s lives, always use the most recent AM 
photos. For adults, use the most informative photos. 

9. Perform CFS using the original AM images, avoiding as much as possible image 
manipulation. 

10. Throughout the entire CFS process be careful to preserve the aspect ratio of the 
photograph. 

11. Keep all the information contained within the original image (do not use 
cropped images, which can introduce error). 

12. Extract as much information as possible from the photograph (digital and visual 
information) to infer original photographic conditions. 

13. Analyze and describe separately both the skull and the face in the photograph(s) to 
be compared (this will include general morphology, specific dimensions, and any 
special, potentially individualizing, characteristics) prior to superimposition. 

14. When multiple candidates are available, sort out AM photos to be compared by 
reference to the existing description of the skull and prioritize them in a 
sequence of most to least likely to correspond. 

15. Use as many criteria as possible in order to study the relationship between the 
face and the skull. 

16. Consider the discriminative “power” of each anatomical criterion. 

17. Give an appropriate “weight” to each criterion according to the degree of 
uncertainty related to it, which will depend also on the AM view. 


8.2.4 Practices in Craniofacial Superimposition That Should 
Be Avoided 


1. Confirmation bias (e.g., coercive situations with investigating authorities, a 
misplaced enthusiasm to be a good citizen and be helpful etc.) 

2. Attempting CFS on edentulous skulls (except in cases where skull morphology is 
highly individualizing with extreme malformations) 

3. Using just one single, low-resolution, frontal passport-style photograph for 
comparison 

4. Cases in which the subject is under the age of 5 years 


8.2.5 Recommended Landmarks to Guide Skull-Face Overlay 


Many CFS approaches make use of homologous craniometric and cephalometric 
landmarks to guide the SFO, that is, scaling, orientation, and projection of the skull 
over the facial photograph. Table 8.1 summarizes those pairs of homologous land- 
marks found by MEPROCS consortium to be the more reliable and effective for 
SFO. In addition, Table 8.2 depicts a second set of homologous landmarks, still 
useful for guiding purposes, but with the agreement of suffering from either diffi- 
culties to be precisely localized or lower orientation utility. Figures 8.1 and 8.2 show 
both sets of recommended and still useful landmarks for guiding SFO. 
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Table 8.1 Recommended 


Craniometric Cephalometric 
homologous Andrarks ior Whitnall’s tubercle (wt) lateral canthus (lc) 
guiding SFO 

subspinale (ss) subnasale (sn) 

nasion (n) nasion (n) 

occlusion mid-incisors (oc) stomion (st) 

porion (po) tragion (t) 

pogonion (pg) pogonion (pg) 

glabella (g) glabella (g) 

prosthion (pr) supra-labiale (sl) 

alare (al) alare (al) 

gnathion (gn) menton (m) 

ant lacrimal crest (la) medial canthus (mc) 
Table 8.2 Other homologous ^ Craniometric Cephalometric 
landmarks still useful for - 3 
guiding SFO zygion (zy) zygion (zy) 

crista conchalis (cc) supra-alare (sa) 

gonion (gn) gonion (g) 

intercanine distance (75%) (id) cheilion (ch) 

supraorbitale (sa) sag eyebrow (se) 
two tangents nasal pronasale (prn) 

Ist premolar/canine radiating line cheilion (ch) 

mastoidale (ma) subaurale (sba) 

infraorbital foramen (if) cheilion (ch) 


In close relation to this, the technological means employed must also be consid- 
ered. If these do not fulfill some basic requirements, they can be part of the problem, 
generating errors and/or introducing more uncertainty. In contrast, they can provide 
an invaluable support when they incorporate, together with those requirements, some 
desirable features that help to reduce errors, uncertainty, and the time employed. 
While the requirements list is intended to be a complete list of features that all the 
equipment has to fulfill, the desirable features should be considered an open list that 
can increase in line with the new research advances in the field. (Tables 8.3 and 8.4 are 
devoted to both the requirements and desirable features of the two main technological 
approaches that coexist in CFS: computer-aided and video superimposition. 


8.2.6 Protocol for Evaluation of Anatomical Consistency 
in Craniofacial Superimposition 


This protocol compiles criteria to be used in the assessment of consistency between 
the superimposed skull and photograph, analyzing anatomical criteria such as the 
concordance between the outlines of the face and the skull, soft tissue thickness, and 
the positional relationship of specific facial and skeletal features. 
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Fig.8.1 In different colors, set of recommended craniometric landmarks for SFO (more reliable and 
effective) and set of still useful craniometric landmarks for guiding SFO, in frontal and lateral view 


Fig. 8.2 In different colors, set of recommended cephalometric landmarks for SFO (more reliable and 
effective) and set of still useful cephalometric landmarks for guiding SFO, in frontal and lateral view 


The examination criteria used in this protocol are based on previous works by 
Chai et al. (1989), Austin-Smith and Maples (1994), Lan (1995), Yoshino et al. 
(1997), Jayaprakash et al. (2001), and Yoshino (2012). The approach underlying this 
protocol requires a good knowledge of the anatomy of the skull and face. 

This protocol offers a significant set of criteria extracted from a scientific study 
and international discussion on their discriminatory power and subjectivity. They 
can be seen as an effort in standardization of the criteria used by human-experts in 
evaluation of anatomical consistency in CFS. 
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Table 8.3 CFS requirements and desirable features for computer-aided equipment 


Tools for computer-aided craniofacial superimposition (3Dskull model — 2D face image) 


Type/name 


3D scanner or CT 
scanner 


Requirements 


Precision < 1 mm 


Desirable features 


Capture of texture information 


MSCT 


Software for landmark 
location 


Tool to locate landmarks 
in a single pixel 


Tool to locate landmarks in a region 


Software for performing 
the skull-face overlay 


Show landmarks 
Transparency mode 
Tools to rotate, translate, 


Wipe mode 
Simultaneous interaction with 3D skull 
and the AM photograph 


and scale the 3D skull 
Tool to properly project 
3D skull onto 2D image 


Software for assessing 
the skull-face 
relationship 


Transparency mode 
mode 


Show landmarks and contours Wipe 


Tool for measuring Euclidean and surface 
distances between points or perimeters 
Tool for marking lines or contours 


Table 8.4 CFS requirements and desirable features for video superimposition equipment 


Tools for craniofacial video superimposition (physical skull-2Dface image) 


Type/name 


Two high-resolution CCD 
video cameras each with a 
TV Zoom lens 


Two high-quality tripods 


Requirements 


Both of the same make and 
specification 


Sturdy and stable while manipulat- 
ing camera movement 


Desirable features 
Minimum resolution: 

600 pixels. 

Zoom lens: Manual, 1.2/ 
12.5-7.5 with ability to 
zoom in focus-locked state. 
Facilities to fine adjust the 
focus maintaining stability. 


A digital video vision 
mixer 


Ability to capture analogue images 
in real time as captured by the CCD 
cameras 


Ability to mix (fade) as well 
as wipe the images. 

Mixing effect should include 
all types of wipe facility. 


A pan and tilt device to 
which the universal skull 
clamp can be fitted 


Capable of supporting the skull and 
effecting the pan and tilt movements 
as from a device with gears 


Stepwise movement is not 
desirable. 

A remote control unit to 
operate the device is 
desirable. 


A video cassette recorder 


Ability to record the real-time ana- 
logue images generated during the 
superimposition 


Enables demonstration of 
superimposition in analogue 
state. 


Video capture software 


To capture the superimposed images 
both frame by frame and as video 
strip 


Enables storage and easy 
retrieval of images from 
computer. 


Illumination system: ver- 
tical stands and lamps 


Stands are to be provided with soft 
dark blue velvet cloth to avoid 
shadow 


Florescent lamps are desir- 
able as the lighting is diffuse 
and white. 
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Table 8.5 Recommended criteria for frontal view photographs 


Group properties Criteria for frontal view Verified? 
Highest discriminative power Dental information (hard tissue to hard tissue 
consistency). 


Good trade-off between subjec- | Gonial flare in the mandible and the postero-lateral 
tivity and discriminative power | jaw angle outline in the face. 


The lateral angle of the eye lies within the lateral 
wall of the orbit. 

The stomion lies at the central incisors (Incisal 
margin of the upper incisors). 


The occlusal and the lip closure line are consistent. 


Evaluate soft tissue thickness at occlussion 
mid-incisors-stomion. 


Evaluate consistency positional relationship 
between the expected position of the Eye ball in 
the skull and pupilare in the photographs. 

The soft tissue position just beneath the eyebrow 
should be more anterior than the orbital rim. 


Marking line used to analyze anatomical consis- 
tency: Entocanthion vertical line. Endocanthion- 
cheilion-entocanthion-caninion [left and right]. It 
is from entocanthion line to cheilion line, parallel 
with the front central line, used to mark the rela- 
tionship of entocanthion and maxillari teeth (Jacob 
and Alt 1995). See Fig. 8.3. 

Easily to evaluate and important | The temporal line is consistent with the outline of 
discriminative power the forehead (Sometimes the temporal line cannot 
be distinguished). 


This step of the CFS procedure is crucial to the whole process. An incorrect 
assessment of the anatomical relationship between the skeletal remains and the 
subject depicted in the ante-mortem image can result in incorrect conclusions. 

Considering that the available ante-mortem and post-mortem data vary from case 
to case, the assessment criteria were divided into those that are usable in frontal and 
lateral views, respectively. The different features and landmarks observed both on 
the skull and the superimposed image were classified into groups, depending on their 
objectiveness and discriminatory power. 

The expert should note if the condition described for a specific criterion is verified or 
not with a certain degree between 1 (not verified at all) and 5 (perfectly verified). The 
verification of a criterion means the consistency between the skull and the face. The 
criteria that cannot be examined should be marked with a 0 (undetermined). The list with 
criteria is shown in Tables 8.5 and 8.6 according to the view of the photograph examined. 

Table 8.7 also depicts those criteria that are not recommended due to their low 
discriminatory power and subjectivity. 

The forensic expert should also list other criteria used that are not covered in this 
protocol, and make more detailed notes on the discrepancies observed with regard to 
a specific criterion or asymmetries observed in the face and the skull, which have a 
direct correlation that are directly correlated and enhance the likelihood of the skull 
being singular to the target person in the examination notes (Table 8.8). 
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Table 8.6 Recommended criteria for lateral view photographs 
Group properties Criteria for lateral/oblique view Verified? 
Best criteria The outline of the frontal bone follows the fore- 
head outline. 
Highest discriminative power The porion aligns just posterior to the tragus, 
but also high variance slightly inferior to the crus of the helix. 
Dental information (hard tissue to hard tissue 
consistency). 
Easily to evaluate and impor- Consistency of the bony and facial outlines/mor- 
tant discriminative power phological curves at the lower part of the face: 
Oblique contour of the mandible follows the out- 
line of the jaw. 
Important discriminative power | Evaluate soft tissue thickness at glabella—glabella. 
and a significant variability The outline of the face and the outline of the skull 
all along the contour follow each other. 
Table 8.7 Criteria not recommended due to low discriminative power and subjectivity 
View 
Left/ 
Not recommended criteria Frontal | oblique 
Marking line used to analyze anatomical consistency: X 
Frontal central line. Glabella-gnathion-glabella-gnathion. 
Soft tissue thickness at gnathion-menton. X 
The chelion lies between the canine and the first premolar (at the X 
occusal line). 
Evaluate soft tissue thickness at nasion-nasion. X 
The chin outline (soft tissue) is consistent with the mental (hard tissue) X 
outline. 
Evaluate soft tissue thickness at Gonion-gonion. X 
Consistency of the bony and facial outlines/morphological curves: oblique | X 
line of the mandible. 
Evaluate soft tissue thickness at pogonion-pogonion. X 
The medial margin of orbit aligns and superimposes with the endocanthion. | X 
The nasion is higher than the nasal root. X X 
The lower margin of the piriform aperture matches the subnasale. X 
Consistency of the bony and facial outlines/morphological curves: the arcus X 
supraciliariaris follows the supraorbital margin. 
Evaluate soft tissue thickness at prosthion-supralabiale. X 
The eyebrow generally follows the upper edge of the orbit over the medial X 
two-thirds. At lateral superior one-third of the orbit, the eyebrow continues 
horizontally as the orbital rim begins to curve inferiorly. 


“X” means not recommended for the corresponding view (either frontal or lateral/oblique) 


Table 8.8 Examination notes ^ Examination notes 


Other assessment criteria analyzed 


Notes on particular discrepancies observed 


Asymmetries on facial and cranial morphology 
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Sagittal line 
- Entocanthion left 
vertical line 


Entocanthion right 
vertical line 


Fig. 8.3 Vertical and horizontal lines to analyze anatomical consistency in frontal photographs 


8.2.7 Final Decision Making 


Finally, Table 8.9 contains a gradual scale for decision making in CFS. The degree 
of support a specific CFS identification case can achieve must be in line with the 
quality and quantity of the materials (AM photographs, mandible, and cranium). 
Additionally, there could be discriminatory characteristics that allow modification of 
the latter degree of support given an appropriate explanation in the report. That is to 
say, Table 8.9 presents some guidelines to choose the most adequate degree of 
support. Considering the materials examined and the consistency of the matching 
between the face and the skull, a final decision should be provided in terms of strong, 
moderate, or limited support to the assertion that the skull and the facial image 
belong to the same person. 
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8.3 Conclusions 


The application of CFS differs greatly among experts worldwide. From the techno- 
logical approach to the order and methodology implemented in each step of the 
procedure, including the process of adjusting the skull and face images and the 
criteria applied to assess the anatomical consistency between them as well as to 
achieve a decision based on the goodness of fit achieved. 

Furthermore, each expert has a different scale designed to determine the final 
decision regarding the identification of the remains. In this chapter, the authors 
propose a series of practical recommendations, pitfalls to be avoided, and a decision 
scale that attempt to unify the application of CFS. These “best practice” suggestions 
are not to be deemed as all inclusive or legally binding, they are the fruit of in-depth 
discussions among practitioners from all over the world, based on the results of a 
series of studies conducted during the project. 


Open Access This chapter is licensed under the terms of the Creative Commons Attribution- 
NonCommercial 2.5 International License (http://creativecommons.org/licenses/by-nc/2.5/), which 
permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium 
or format, as long as you give appropriate credit to the original author(s) and the source, provide a 
link to the Creative Commons license and indicate if changes were made. 

The images or other third party material in this chapter are included in the chapter’s Creative 
Commons license, unless indicated otherwise in a credit line to the material. If material is not 
included in the chapter’s Creative Commons license and your intended use is not permitted by 
statutory regulation or exceeds the permitted use, you will need to obtain permission directly from 
the copyright holder. 


Chapter 9 A 
MEPROCS Framework Validation iin 


9.1 Introduction 


The purpose of this study is to validate the CFS framework developed during the last 
2, years and agreed by the MEPROCS consortium. Thus, all partners will be asked 
to deal with a variable (according to their availability and time constraints) number 
of CFS cases (positives and negatives) following all the recommendations collected 
within the framework referring to the procedure and the materials, the set of 
landmarks and criteria, the decision gradual system, and the requirements of the 
technical equipment. Individual and average performance will be compared with the 
performance achieved in Chap. 7 to check for a possible improvement as a conse- 
quence of following MEPROCS framework. Although a large number of cases have 
to be tackled within a significant reliability study, the current analysis will also serve 
to give an idea of the reliability of the methodology proposed. In addition, it can be 
also useful to study the influence of the technological means employed and the 
knowledge and experience of the practitioner performing the superimpositions. 

The dataset used in this study consists of eight identification scenarios (S1-S8). 
Each of the first four scenarios (S1—S4) implies a comparison of one skull and four 
candidates with a variable number of AM photographs. Each of the last four 
scenarios (S5S—S8) involves a comparison of only one candidate, with a variable 
number of AM photographs, and four different skulls. Thus, these eight scenarios 
correspond to a total number of 32 CFS cases, which at the same time involve up to 
72 SFO problems as Table 9.1 details. The dataset was collected at two different 
institutions, the Laboratorio di Antropologia e Odontologia Forense (Italy) and the 
University of Vilnius (Lithuania), after obtaining informed consent from the respon- 
sible party for the deceased, and provided to the MEPROCS project following the 
data share protocol established by the project ethical committee. 

The dataset provided for analysis consisted generically of a set of AM photos, 
photos of the skull (with scales), and a set of 3D models of the skull acquired by the 
structure light scanner Artec MHT. Each set of case studies had the following 
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Table 9.1 Summary of the materials forming the dataset for the study 


Scenario | Z CFS |#Skulls | #Candidates | # Photos | #Max SFO | # Positive/negative CFS 
S1 4 1 4 4-2-1-2 |10 1⁄3 

S2 4 1 4 1-3-2-2 8 1⁄3 

S3 4 1 4 3-2-3-1 9 1/3 

S4 4 1 4 3-1-3-2 9 1/3 

S5 4 4 1 2 8 1/3 

S6 4 4 1 1 4 1/3 

S7 4 4 1 3 12 0/4 

S8 4 4 1 3 12 1/3 

Total 32 20 20 45 72 7/25 


structure: cases 1—4 mimic a scenario with one skull and three possible candidates, 
where only one ante-mortem photo of each candidate is available. In case 5, a more 
complex scenario is simulated, including four skulls and four possible candidates, 
with only one available ante-mortem photo of each candidate. In cases 6 and 7, the 
scenario simulated includes one skull and only one possible candidate, with several 
photos of the candidate available for analysis. Participants were not asked to tackle 
neither all the cases nor all the superimpositions within each case. 

All the participants had to follow MEPROCS CFS framework, that is, best 
practices and recommended assessment criteria (detailed in Chap. 7). 

This framework includes: 


* The sources of uncertainty that have to be considered during the whole process 

° The sources of error that have be minimized as much as possible 

* The best practices that must be followed 

* The practices that should be avoided 

° The most appropriate pairs of homologous landmarks for orientation and 
assessment 

° The requirement and desirable features of the technical means employed 

° The most important criteria that must be evaluated for assessing the anatomical 
skull-face relationship 

* The degrees for the craniofacial correspondence evaluation and the requirements 
to achieve each degree 


All these recommendations have to be followed by all the participants in the 
current study. As a result of having a common methodology, “only” the technical 
means (that have to fulfill some requirements as well) and the knowledge and the 
experience of the practitioner should make a significant difference among the 
process followed by all the participants. 

There are some of the issues included in the best practices that cannot be fulfilled 
due to the multicenter nature of the study. In particular: 


* Use the real skull to confirm correct fit of the mandible with the cranium. 

* Use the real skull and mandible to articulate the dentition and establish centric 
occlusion. 

* Locate and mark landmarks on the skull before scanning. 
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Fig. 9.1 Skull 3D model without texture information (on the left) and with texture information 
(on the right) 


To minimize these shortcomings, we have obtained a digital replica of all the 
skulls with a precise 3D scanner device, which provided both accurate and realistic 
3D models according to the original geometry and texture of the physical skull (see 
Fig.9.1). 

Cranium and mandible are provided as separate 3D objects, so the participants 
can reproduce the position of the mandible as displayed in the AM photograph. In 
addition, they are also provided articulated as a single 3D object to better display the 
mandible articulation to minimize the effect of the second point. Landmarks were 
not located before scanning to avoid bias in the study since this point is already an 
issue that creates difference among different experts. 

The fulfillment of the rest of the points included in the best practices is not always 
possible. The participants are limited by the quantity and quality of the materials and 
thus, according to the decision degrees in CFS, the confidence on their decision has 
to be adapted. Tables 9.2, 9.3, 9.4, and 9.5 summarize all these information. For each 
case study, it details the quantity and quality of the material of the corresponding 
CFS problems (for CFS problems for each identification case study). Each SFO 
implies the comparison of a single AM photograph with a skull 3D model. Thus, the 
following columns give information about the quality of both the image and the 
skull. In particular, the view of face of the subject within the photograph, if the 
photograph is the original or has been modified (mainly cropped from a larger 
photograph), if it is digital photograph or it is scanned, if the quality (mainly 
resolution) of the image fulfills MEPROCS guidelines, if the teeth of the subject 
are visible, and if there is any obscuring object or phenomena complicating the 
identification. Some remarks are given also to indicate other difficulties; in this study 
in particular, the perspective of some of the photograph could be difficult to achieve 
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during the skull superimposition. Finally, it should be included information about 
the dentition of the skull, a “NO” means that the skull does not have enough 
dentition for teeth comparison purposes. 

The last two columns refer to the real skull-face relationship, that is, the ground 
truth data (GT). The first of these two columns, *GT.I indicates whether the result of 
the CFS problem should be positive (P) or negative (N). The last column, “GT.IT”, 
refers to a ground-truth value different from the binary positive and negative real 
correspondence. It is a value established “manually” according to the scale defined in 
the decision degree table of MEPROCS framework and the quality and quantity of 
the materials described in Table 9.1. However, there is one important issue that could 
not be considered while establishing this second ground truth. As the decision degree 
table asserts: “There could be discriminatory characteristics that allow going left of 
right within the scale given an appropriate explanation in the report.” This is not 
possible to model a priory, because it belongs to the anatomical correspondence 
interpretation by the participant. We have only modified “GT.II” in CFS cases 3 and 
4 in the identification case study 2, since the AM photographs clearly belong to 
Caucasian women while the cranium belongs to a Negroid. 

Experience and familiarity with craniofacial identification techniques was also 
taken into account and level of experience of the participants was classified 
according to the following scheme: 


. No previous experience and no CFS-related training 

. No previous experience but CFS-related training 

. Short previous research experience and CFS-related training 

. Moderate previous experience with CFS real cases and CFS-related training 
. Broad experience with CFS real cases 


Un RU N — 


The study was carried out by 12 participants from the following institutions: 
University of Granada (Spain), Legal Medicine and Forensic Sciences Institute 
(Peru), Complutense University of Madrid (Spain), University of Melbourne 
(Australia), Azienda Ospadaliera-Universitaria di Trieste (Italy), Russian Academy 
of Sciences (Russia), National Research Institute of Police Science (Japan), Univer- 
sity of Milan (Italy), and Portuguese Judiciary Police (Portugal). Table 9.6 lists all 
the participants (numbered from 1 to 12) with their corresponding level of experi- 
ence. Since not all the participants completed the whole study, information on the 
number of CFS addressed is provided as well. Finally, the last column depicts an 
approximate degree (linguistic scale) of the fulfillment of the guidelines suggested in 
the framework. Differently to the first study, there were no participants following 
neither a computer-aided manual video superimposition approach nor a computer- 
aided manual photo superimposition approach. They all followed a computer-aided 
3D-2D superimposition approach, manual in every case but participant 1 who 
employed a semiautomatic software. 

After finishing every superimposition, participants were asked about the fulfill- 
ment of each point within the best practices and the practices that should be avoided 
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Table 9.6 Participants of the study, their experience related to CFS, and number of CFS cases 
addressed 


Participant ID CFS experience CFS addressed MEPROCS framework fulfillment 
1 3 32 High-moderate 
2 4 12 Moderate-high 
3 5 32 Moderate 
4 5 32 High 
5 2 9 Moderate-low 
6 3 30 Low 
7 4 31 Moderate-high 
8 1 7 Low 
9 2 8 Low 

10 1 7 Low 

11 4 32 Moderate-high 

12 1 12 Low 


in order to obtain a degree of fulfillment of the framework. They were also asked if 
the computer tools employed are in line with the requirements and desirable features 
established along the framework. Additionally, we double checked the same points 
through the examination of the CFS image results provided by the participants. As a 
result, a few contradictions were found in some cases while absence of evidence 
supporting participants’ answers in others. Thus, we finally arrived at Tables 9.7 and 
9.8, which in most of the cases collect participants’ answers (Wp: Whenever it was 
possible; “N”: No; “Y”: Yes) but sometimes the values were changed when it was 
clear that the participant does not apply a particular point of the framework. 
Additionally, when no evidences were provided, despite participant response, we 
indicate “Ne,” that is, participants answered “Yes,” but there is no evidence that they 
fulfilled this point. 

Concerning the practices that should be avoided all of them answer “Yes” to the 
first point (confirmation bias), whenever it was possible to the second and third 
points (edentulous skulls and one single low-resolution image). 

Apart from the 17 methodological points included in Table 9.7, MEPROCS 
framework also defines some requirements (7) and desirable features (8) concerning 
the computerized tools employed for acquiring, visualizing, and superimposing the 
skull 3D models over the AM photographs. Table 9.8 depicts which of these 
characteristics are provided by the systems they employed and which ones not. 

Finally, participants were asked to fulfill a table with the corresponding degree of 
consistency of MEPROCS recommended criteria for each SFO addressed to include 
at least one image showing the superimposition obtained, indicating the time 
employed (see the last column of Table 9.8). At the end, for each CFS they were 
asked to provide a numeric decision according to the defined degrees of decisions 
(Damas et al. 2014). That numeric decision had to be supported by a decision report 
summarizing the main significant anatomical similarities and/or inconsistencies. 


9 MEPROCS Framework Validation 


162 


(e]qrpueur oy} oym) wne ay) IsNf Sšuisn suonirsoduruedns əy} peuuoj1od 
Kat ‘sosed OAS Əutuos ur *os[? Ing ude1Soloud JAY eu ur peKe[dsrp se o[qrpueur ay) Jo uonrsod oq Suronpoddor sproar Á[uo Jou cq 184) Ə)ou 0} JU€)JOdUIT SI I], 


ƏN ƏN 9N dm 9N X N X X *N dm dm dm N N N N Id 
A A A A A A A A A eN dm dm dm N N N N IId 
A dm A N A dA A A A YN dm dm dm N A N N Old 
N A 9N A ƏN N A A A eN dm dm dm N A N N 6d 

ƏN ƏN 9N N 9N A A A X eN dm dm dm N A N N 8d 
A A A A A A A A A eN dm dm dm N N N N Ld 
A A A N oN dA A A A YN N dm dm N N N N 9d 
A A A A A A N A A eN dm dm dm N N N N Sd 
A A A dA ƏN A A dm A eN dm dm dm N A N N bd 
A dm A dm 9N A A A A eN dA dm N N eN N N £d 
X X X X X X X X N X N N Td 
A A A A A A A A N A N N Id 
LI 9I I 6 r ç [4 I 1uedionreq 

uonisoduruedns [eroejorugJo ut soonovid 1898 


syuedionied oy) Aq yuowT[Y[Ny soonoed 3599 L6 ALL 


9.2 Results 163 


Table 9.8 Fulfillment of the requirements and desirable features of the computer-aided tools 
employed by the participants 


Requirements Desirable features 


Participant 

Pl 

P2 

P3 

P4 

PS 

P6 

P7 

P8 

P9 

P10 

P11 

P12 
N no, Y yes 
“Despite participant P1, it is not clear if the rest of participants that assert using software that 
properly projects the 3D skull employed this feature or there is not such a feature or is rather limited 
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9.) Results 


A total number of 244 CFS problems, involving 382 SFOs, have been tackled by the 
participants. Their performance was measured according to true positive (TP), false 
positive (FP), true negative (TN), and false negative (FN) rates, together with expert 
proficiency (EP). All the indicators were calculated as the mean performance of the 
participant according to the number of CFS addressed. Additionally, we have also 
calculated a correlation value p,and a similarity value s. 


Expert proficiency is calculated as EP = NH? | where P and N are the number of 


Xu - 2) (y - y) 


V, (x 2 J Dili E D | 
1- > e-l) f 


Nx3 


positive and negative cases, respectively. 


The equation for the correlation coefficient p, is: 


The equation for the similarity coefficient s is: 


where X and Y are two sets of samples, x and y their respective means, and lx;l and | 
yil the absolute values of a particular sample of sets X and Y, respectively. N is the 
total number of samples. In Tables 9.9, 9.10, and 9.11, the set of sample X and 
Y corresponds to “GT.IT” values (Table 9.2) and the identification decisions made by 
a particular participant, respectively. 

While p¡measures the correlation between the participants’ decision and the 
ground-truth value according to MEPROCS scale (“GT.IP”, s considers only the 
absolute values of the same variables. Thus, p, calculates a correlation value 
according to correct and incorrect decisions and how well correlated is the degree 
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Table 9.10 Identification performance of different groups of participants according to the degree 
of fulfillment of the framework 


Average All Without L Without M and M-L Without M-H 
TP 61.97% 67.58% 74.41% 78.57% 

TN 90.27% 91.42% 92.58% 100.00% 

FP 9.72% 8.57% 7.4296 0.0096 

FN 38.02% 32.42% 25.59% 21.43% 

EP 83.88% 86.11% 88.50% 95.31% 

- 0.51 0.52 0.58 0.67 

- 0.71 0.72 0.75 0.70 

# CFS cases 242 180 139 64 


Table 9.11 Identification performance of different groups of participants according to the partic- 
ipants’ CFS experience 


Average All Experience>1 | Experience>2 | Experience>3_ | Experience>4 
TP 61.97% | 64.05% 63.25% 64,543% 57.14% 

TN 90.27% | 91.16% 91.71% 89,820% 94.00% 

FP 9.72% 8.83% 8.28% 10,180% 6.00% 

FN 38.02% | 35.94% 36.74% 35,457% 42.85% 

EP 83.88% | 85.32% 85.57% 84,173% 85.93% 

= 0.51 0.52 0.51 0.51 0.50 

- 0.71 071 0.71 0.71 0.62 

#CFS cases |242 218 201 139 64 


of support of such decisions with the scale defined in MEPROCS framework. In 
contrast, s is intended to isolate the measurement of the correlation in the degree of 
support (either positive or negative) of the decision. 

Table 9.9 details participants” performance together with the degree of fulfillment 
of the framework according to the following scale: High (“H”), Moderate (“M”), 
Low (“L”), and their possible combinations. 

Considering only the global performance (“EP”), 5 of the 12 participants carried 
out more than 90% of correct identification decisions. In particular, Pë managed to 
achieve a 100% of correct decisions although he/she only addressed 7 out of the 
32 CFS cases. Contrary, P1 with a 96.87%, P4with 93.75%, and P11 with 90.62% of 
correct decisions tackled all the CFS cases (32). The worst results were achieved by 
participant 10 with only 57.14% of correct decisions over the seven CFS cases faced. 
The average performance is 83.88%. With a similar tendency as the previous study 
developed (deliverable D4.4), “TN” and “FP” rates are clearly better than “TP” and 
“FN.” In fact, four participants (P1, P2, P4, and P8) perfectly addressed negative 
cases, and the average “TN” rate is 90.27%. Additionally, looking at the correlation 
values (01), we can conclude that the decisions of the participants are well correlated 
with those expected within the scale given by MEPROCS framework. Table 9.9 also 
includes the significance (p-values) for the following null hypothesis “There is no 
linear correlation between the participants’ decisions and GT.II" with different 
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degrees (*p < 0.05, **p < 0.01 and ***p < 0.001). Thus, according to the achieved 
p-values (super-index attached to each particular correlation value), all the partici- 
pants’ decisions except that of P12 are correlated with the expected decisions. 
Finally, higher values are obtained in the case of the similarity coefficient s. Such 
values increase because only the degree of support is considered. 

The same average values are depicted in the first column of Table 9.10. However, 
we also include different average rates corresponding to different groups of partic- 
ipants with an increasing degree of fulfillment of the framework (see Table 9.10). In 
this sense, the second column refers to those participants who obtained at least a 
medium degree, the third includes only those participants who obtained at least 
medium-high degree, and finally, the last column includes participants with high- 
medium and high degree of fulfillment of the framework. From this figures, we can 
appreciate a significant improvement in participants’ performance in line with the 
degree of fulfillment. Expert proficiency varies from an average value of 83.88% to 
95.31% of the last group. Similarly, “TN” rates go from 90.27% to an outstanding 
100.00%.Although correlation follows the same increasing tendency, values slightly 
increase within the first groups and decrease in the last one. 

Previous experience in CFS appears to not be a relevant factor in the identification 
performance (see Table 9.11). Only slightly differences are found when not consid- 
ering participants that asserted to not have previous experience and CFS-related 
training. 

Finally, Table 9.12 compares the performance of those participants that accom- 
plished the two experimental studies designed by MEPROCS with the aim of testing 
CFS methodologies, tools, and practitioner’s experience. While in the first one, the 
participants followed their own methodology, in the current study, they were forced 
to stick to MEPROCS framework, which also established some requirements and 
desirable features for the tools employed. The first important issue is the number of 
participants that performed the both studies, nine in total, addressing 520 CFS cases 
in the first study and 222 in the second. The average performance values are better in 
the second study for the percentage of correct decisions (84.09% against 79.75%), 
“TN” (90.54% against 83.33%) and “FP” (9.54% against 16.66%) rates. “TP” 
(61.35% against 62.77%) and “FN” (38.64% against 37.22%) rates are slightly 
worse in the second study. However, such percentages are really similar in both 
studies. 

Finally, we computed some statistics using the values given by the participants to 
each particular criterion in each particular SFO case. First, the average standard 
deviation is used to numerically examine the differences while assessing (values 
from 0 to 5) the same criterion in all the SFO cases by the different participants. 
These values range from 0.87 (criterion 3.19 in frontal view, dental information) to 
1.61 (criterion 1.7 in frontal view, entocanthion vertical line right). 

Differently to pı, we have calculated the correlation between the SFO binary 
(either positive or negative) ground truth (*GT.I") and the values given by the 
participants to each particular criterion in each particular SFO case. The equation 
for this correlation coefficient p2is the same as p; but X sample refers now to binary 
ground truth of the SFOcase, *GT.I'(Tables 9.2-9.5) and Y sample refers to the 
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values given to the different skull-face correspondence criteria by the different 
participants. Similar to Table 9.9, Table 9.13 also includes the significance (p- 
values). According to them, the majority of the values given to the criteria by the 
participants are correlated with the CFS binary ground truth values (“GT.I”). Only 
criteria 1.70 and 2.22 (in frontal view), and 4.17 and 4.14) in lateral view resulted to 
be not correlated. The strongest correlation (p-values lower than 0.0001) is achieved 
by criteria 3.19, 4.20, 4.50, 4.10, 2.23, 3.10 (in frontal view) and 3.19, 3.18, 2.40, 
3.11, and 2.90 (in lateral view). Exactly the same statistical results were achieved 
using Spearman correlation (“Sp”) and regression (“r”), thus reinforcing the latter 
conclusions. 


93 Discussion and Conclusions 


The main goal of this experimental study is to validate the framework for CFS 
developed by MEPROCS consortium. Thus, a multiparametric analysis is discussed 
in this section according to framework understanding and fulfillment, participants’ 
performance, and correlation between expected decisions and those given by the 
participants. While the latter two issues can be quantitatively validates, only a 
qualitative validation is possible for the former. 


9.3.1 Framework Understanding and Fulfillment 


Last column of Table 9.6 shows the degree of fulfillment of the framework by each 
participant. This degree was “manually” fixed following a quantitative approach 
with a certain degree of subjectivity. Degrees have been assigned according to the 
number and importance of practices and requirements not fulfilled. Even if all the 
participants were asked to fulfill every single point of the framework, the average 
degree of fulfillment is moderate. The main reasons for not following the recom- 
mendations could be summarized as follows: 


e Impossibility due to limitations on the design of the study 

° Impossibility due to limitations on the practitioner skills or tools 

* Framework misunderstanding or resistance to change practitioner's normal 
procedure 


As we explained, a few points were not possible to be fulfilled because of the 
remote nature of the study and the impossibility to share the actual skull, in particular 
points 1, 2, and 4. Point 8, “During the growth and development stages use the most 
recent AM photos," was not applicable in the study, since there are no cases 
corresponding to juvenile people. Almost all the participants answered "whenever 
it was possible" for points 5, 6, and 7. These points refer to the use of multiple AM 
photos in different poses, AM photographs with a good quality and images without 
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obscuring objects. Among them, as Table 9.5 shows, there are some cases where 
these conditions are not fulfilled; hence, most of the responses were Wp. Still 
referring to the AM pictures, most of the participants followed points 9, 10, 
11, and 12. However, some authors decided to not articulate the mandible according 
to the AM photograph (point 3). This task was identified as an important source of 
error (approach CFS without a correct mandible position) but also a source of 
uncertainty (it is not possible to know exactly the precise articulation). The lack of 
proper skills or the absence of adequate tools could be the reasons to avoid mandible 
articulation, which has been identified as a difficult task. 

The main limitations arose with the computer software employed. Eight of the 
participants noted that their software does not allow to locate or show landmarks, 
four participants recognized that the computer program employed does not allow 
transparency mode. Also in the requirement part, it is not clear if the participants that 
assert using a software that properly projects the 3D skull employed this feature or 
there is not such a feature or is rather limited. When analyzing the degree of 
fulfillment of the desirable features for CFS recommended in the MEPROCS 
framework, the situation is even worse. Six of them do not provide visualization 
capabilities of 3D models with texture information, eight of them do not allow wipe 
mode, three do not provide tools for the simultaneous interaction with 3D skull and 
the AM photograph, and only two of them provide tools for marking contours and 
lines and distance measurement. 

Although all the participants reported to fulfill point 11, “...do not use cropped 
images. . .", four participants provided cropped images as a result. They then recog- 
nized to crop the image before performing the SFO. This could have a negative effect 
depending on the software employed and the perspective of the particular 
photograph. 

A majority of the participants did not give evidences of fulfilling point 13, “ana- 
lyze and describe separately both the skull and the face in the photograph(s) to be 
compared. ..”. A clear example is the identification scenario S2 where the skull 
belongs to a Negroid subject and three of the four possible candidates are clearly 
Caucasians. Just a few participants documented this issue and avoided to perform the 
corresponding SFO. 

Opposite to point 15, “use as many criteria as possible in order to study the 
relationship between the face and the skull,” some of the participants only provided 
values for the framework criteria without further analysis of other criteria. It is not 
clear if they mentally or methodologically employed other criteria, but there is no 
evidence to consider that. Similarly, a few authors did not provide any evidence of 
following recommendations 16 and 17. “Consider the discriminative “power” of 
each anatomical criterion" and “Give an appropriate “weight” to each criterion ...”, 
respectively. Behind the absence of evidences for points 13, 15, 16, and 17 could be 
the nature of the task (experimental study against real identification scenario) and 
time constraints that make practitioners to be less precise and rigorous in their 
reports. 

Similarity coefficient s values are in general high, what denotes a good under- 
standing and fulfillment of the decision degrees table of the framework. 
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The main conclusion of the framework understanding and fulfillment is that, in 
general, the best practices and software requirements were understood. However, it 
was difficult to follow all the recommendations mainly due to design limitations and 
lack of specific software. 


9.3.2 Participants’ Performance 


Results depicted in Tables 9.11 and 9.13 show a clear improvement in the perfor- 
mance linked with the fulfillment of the framework. This is quite obvious when 
considering incrementally those participants with at least a certain degree of fulfill- 
ment of the framework (Table 9.11). We can assert that for the given study, the 
relation between performance and framework fulfillment is almost linear. Even if the 
degree of fulfillment of the framework is not considered, there is still an objective 
improvement in the performance. This fact is demonstrated in Table 9.13. The 
results of the same group of participants in two similar studies were compared. In 
the first one, the participants followed their own methodology, while in the current 
study, they were required to follow MEPROCS framework. There is an improve- 
ment in the global performance and, in particular, in “TN” and “FP” rates. At this 
point, it is important to note one important difference between the types of identi- 
fication scenarios presented in both studies. While in the current study, there are at 
least two AM photographs in 27 of the 32 CFS problems, in the study subject for 
comparison (Ibáñez et al. 2014b), only 4 of a total of 60 CFS problems involve the 
comparison of more than one AM photograph. 


9.3.3 Correlation 


Together with the analysis presented in Tables 9.7 and 9.8, the correlation values 
obtained reinforce the assumption that the introduction of framework improves 
participants’ performance. Although not directly related with “EP,” p, correlation 
is in general higher for those participants performing better (see Table 9.10). In 
addition, p-values demonstrated a strong correlation between the expected decision 
and the performance. Similarity coefficient s values are even higher than correlation 
ones. This closer relation could be expected, since s coefficient does not link 
participants" decisions with correct decisions by just with the expected degree of 
support. 

One important factor that could not be considered when we established the 
ground-truth values of each CFS case (“GT.IP” in Tables 9.1-9.5) refers to the 
inability to model in advance discriminatory characteristics of either the skull or 
the face in the AM photograph that allow, as indicated in the definition of the 
decision degrees table of the framework, going left of right within the scale given 
an appropriate explanation. This fact presumably has an influence in the correlation 
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values as ground-truth values did not consider discriminatory characteristics but just 
quality and quantity of the materials. 

The assessment of the skull-face relationship criteria made by the participants 
resulted in its being correlated with the CFS cases ground truth (“GT.P”) in the 
majority of the cases. However, criteria 1.70 and 2.22 (in frontal view), and 4.17 and 
4.14(in lateral view) are not correlated. We find two possible explanations of the lack 
of correlation for these criteria. 

Although the proposed methodologies for achieving an optimal and unbiased 
SFO (Ibáñez et al. 2015) and for the analysis of the criteria for assessing skull-face 
correspondence in craniofacial superimposition (Ibáñez et al. 2014a) were them- 
selves a great achievement, the conclusions drawn in the criteria study, as pointed 
out by the authors, were influenced by the materials employed (i.e., cone-beam CTs 
that lacked the upper part of the skull and presented additional inconveniences), and 
more thorough studies have to be developed. The low correlation values could be 
also explained through the different SFO obtained by the participants. As pointed out 
in the first study (Ibáñez et al. 2014b), that of course had a clear influence on the 
analysis of the morphological relationship. A common problem that still affects 
MEPROCS framework is the absence of an objective evaluation of the resulting 
SFO. Each participant followed a different approach, and it is not possible to say 
which one is better without the ground-truth data. 
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Chapter 10 A 
Conclusions iin 


10.1 Introduction 


The conclusions of this handbook cannot be separated from the MEPROCS project 
where the manuscript was first conceived and then progressively developed by the 
team through a wide variety of tasks contributing to the final document. 

It is not a trivial task to summarize the main points resulting from 30 months of 
difficult work at an international level. Beyond the particular conclusions that are 
detailed below, the main global achievement of the MEPROCS project is the focus 
toward an international standard in craniofacial superimposition. To the best of our 
knowledge, such standardization has never been attempted before in the field of 
forensic anthropology. Furthermore, the particular standardization approach 
followed in MEPROCS and described in this handbook can be easily replicated in 
some other forensic disciplines where similar initiatives are demanded. 

The absence of similar joint efforts in the past or at least the lack of public 
documentation represented a real challenge for MEPROCS. This handbook is a first 
attempt to resolve the situation and facilitate similar works in the future. 

In this chapter, the main achievements of the MEPROCS project are presented in 
Sect. 10.2. Sect. 10.3 describes the problems encountered during the project and the 
way they were solved. Section 10.4 is devoted to present some future works and 
research proposals. Finally, some concluding remarks are included in Sect. 10.5. 


10.2 Main Achievements 


When compared to what the state of the art was before MEPROCS, there are plenty 
of important achievements that are directly related to the tasks performed in the 
project. Some of the most representative are enumerated as follows: 
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° The handbook. This represents one of the most important achievements of the 
project. From the very beginning, when the MEPROCS proposal was formulated 
and submitted for evaluation to the European Commission, it was our intention to 
achieve an international agreement with practical use. This was a twofold chal- 
lenge: the contents and its distribution. The former was a challenge, because the 
standardization task had not been tried before in the field. The distribution was 
also challenging as we wanted to facilitate as much as possible global access to 
the handbook. The publication in an open-access format by Springer (one of the 
leading publishing companies in the world) solved this issue. 

° Global effort. One of the most important MEPROCS characteristics was the aim 
to be a global initiative. It was global because for the first time there was a 
collective, interdisciplinary, and international effort focusing on craniofacial 
superimposition. Furthermore, it was open and inclusive so that new institutions 
interested in this technique could join the project at any time. The conclusions of 
the project would be more important for the evolution of the technique and the 
profession in general, if the final number of participants was greater than the 
initial consortium. In particular, the number of institutions involved in 
MEPROCS evolved from the starting 7 institutions up to more than 30. At the 
moment, most of the participant institutions are willing to continue in collabora- 
tion to achieve the pending MEPROCS objectives together with any other task 
that could contribute to the evolution of the technique beyond the time constraints 
imposed by the commitments related to a project using public funds. 

° Global analysis. For the first time, the technique was analyzed considering the 
different tasks involved along the whole process of craniofacial superimposition, 
that is, from the very first steps to study the skull found (once cleaned) to the final 
report. This type of analysis may be considered global in its approach. 

° Global participants. MEPROCS attracted the attention of a broad variety of 
end-users, that is, professionals who have important responsibilities in forensic 
identification. In particular, both researchers and practitioners were crucial to 
achieve the MEPROCS objectives. Among them, we emphasize the collaboration 
of the police forces of four different countries. Furthermore, the role of the 
technical institutions that joined MEPROCS was equally important and the 
need for a multidisciplinary team to properly approach the CFS technique was 
demonstrated. 

° Common data. In order to achieve international agreements that lead to standards 
on CES, it was vital to avoid the bias induced by the subjective evaluations of the 
results. That was only possible with a purely objective approach to all the 
MEPROCS tasks based on the study of the same data. Important legal and ethical 
issues were analyzed and addressed in order to share the data among the 
MEPROCS participants worldwide. Finally, we would like to thank the data 
providers for their altruistic and crucial contribution to the success of the project. 
In particular, Prof. Caroline Wilkinson (University of Dundee) who provided the 
data with the permission of the University of Tennessee, Dr. Fabio Cavalli 
(Azienda Ospedaliero-Universitaria di Trieste) who provided clinical data, 
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Dr. Cristina Cattaneo (University of Milan), and Dr. Rimantas Jankaukas (Vilnius 
University) who provided data from their own laboratories. 

° Ground truth. Unlike some other more established forensic techniques, there was 
a lack of ground-truth data in craniofacial superimposition, that is, a procedure 
that could provide a perfect skull-face overlay in an objective and unquestionable 
manner. This information is fundamental for the appropriate validation of any 
technique. MEPROCS provided the first ground-truth dataset for craniofacial 
superimposition. Only with the availability of such ground-truth data, the most 
relevant criteria to analyze a particular superimposition could be recommended. 

° Specialized training. The International Conference on Craniofacial Superimpo- 
sition (ICCFS-2014) took place in Dundee in July 2014. It was the final and most 
important MEPROCS event and the first international conference specifically 
devoted to craniofacial superimposition. The ICCFS-2014 technical program was 
rich and varied, including two keynote speakers renowned worldwide. During the 
last 3 days of the conference, the delegates (more than 100) had a unique 
opportunity to receive a diverse and high-quality training on craniofacial super- 
imposition based on the MEPROCS recommendations and including the 
approaches of different laboratories from all around the world. 

° First standard in the field. The aim of the first technical study performed in 
MEPROCS was to assess the reliability of different craniofacial superimposition 
methodologies and the corresponding technical approaches to this type of iden- 
tification. With all the data generated, some of the most representative experts in 
craniofacial identification joined in a discussion intended to identify and agree on 
the most important issues to be considered for craniofacial superimposition. As a 
consequence, the consortium produced the first standards in the field, including 
best and worst practices, sources of error and uncertainties, technological require- 
ments and desirable features, and, finally, a common scale for the craniofacial 
matching. 

° Set of evaluation criteria. The purpose of the second technical study was to 
analyze the subjectivity and discriminative power of the different criteria for 
assessing the skull-face correspondence as proposed in the literature or by any 
of the MEPROCS partners. This novel study provided important insights to better 
understand: (1) which are the most and less discriminative criteria; (2) which 
criterion depends more on the expert who is evaluating it and which criteria are 
more independent, that is, less subjective. Even though the conclusions drawn in 
the study were influenced by the materials employed (i.e., cone-beam CTs 
[CBCTs] that lacked the upper part of the skull and presented additional incon- 
veniences), the proposed methodology was itself a great achievement that may 
lead to further and more thorough studies. 

e MEPROCS framework. According to the conclusions of the two technical studies, 
the MEPROCS consortium defined the MEPROCS framework to aid in the 
application of craniofacial superimposition. The framework consists of best and 
worst practices, sources of error and uncertainties, technological requirements 
and desirable features, a common scale for the craniofacial matching evaluation, 
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and finally a set of evaluation criteria. See Chap. 8 for a detailed description of the 
framework. 

° Performance evolution analysis. Once the craniofacial superimposition frame- 
work was proposed, a third technical study was performed. All partners were 
asked to deal with a variable number of CFS cases (positives and negatives) 
following all the recommendations collected within the framework. Individual 
and average performance was compared with the performance achieved during 
the first study in order to analyze its evolution (either positive or negative) when 
considering the MEPROCS framework. Though the number of participants was 
limited, the performance of the majority improved when they followed the 
MEPROCS recommendations. 

° International awareness. Craniofacial superimposition, although existing for at 
least a century, is still a controversial technique within the scientific community. 
That is demonstrated by the small number of recent publications. The evolution of 
the use of craniofacial superimposition strongly depended on the specific country 
and the frequency of potential cases as well as the available means to apply 
alternative identification techniques. In developed countries, the small number of 
cases and the recent advances in alternative and more expensive techniques for 
identification led to a progressive reduction in the application of craniofacial 
superimposition. In contrast, the large number of cases in developing countries is 
typically related to high criminal rates or humanitarian issues such as crimes 
against humanity or identification following mass disasters. Also, the funds for 
identification are usually limited in these regions. This situation leads to a very 
frequent application of the technique in such countries. MEPROCS faced this 
duality and the need to awaken interest on the international consolidation of the 
technique. In particular, different labs have shown a new interest in craniofacial 
superimposition. MEPROCS has also laid the foundations for a more reliable 
technique. Definitely, the advances in the reliability of the technique will involve 
a broad number of new stakeholders. 

° From experts’ opinions to studies of metadata. In craniofacial superimposition, as 
in forensic identification in general, both legal authorities and the scientific 
community are insisting upon real science in forensic identification, that requires 
the successful demonstration of individualization (i.e., an expert’s confirmation 
of a particular set of characteristics unique to the deceased (Holobinko 2012). The 
core assumptions that underpin conventional forensic craniofacial superimposi- 
tion rely more on experience and faith than on empirical evidence. Perception and 
judgment may be affected by bias, expectations, beliefs, and motivations. Many 
forensic disciplines, including identification sciences like anthropology, involve 
some degree of subjectivity. Disciplines like forensic anthropology may be 
problematic to the courts since they may sometimes employ a combination of 
traditional scientific methodologies and less rigorous observational methodolo- 
gies coupled with case study evaluations or casework experience. Since the 1993 
US Daubert ruling, many forensic disciplines including anthropology have deter- 
mined that there is a need to critically reevaluate some of the techniques and 
methods used in their examinations, as well as the validity of the underlying 
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scientific theories (Christensen and Crowder 2009; Saks 2010). It is therefore 
imperative to minimize the risk of error through quality assurance (i.e., proper 
training, method validation, accreditation, and certification). Quality assurance in 
forensic anthropology can be established through validation studies of analytical 
methods in order to determine method reliability (precision and accuracy) and 
through the development of professional standards in the form of best practice 
protocols. Subjectivity is not necessarily equal to unreliability (Christensen and 
Crowder 2009); thus, nothing is preventing at least some types of anthropological 
testimony from being admitted as technical expert testimony under the Kumho 
standard, as the court acknowledges that science is too complex to evaluate with a 
single set of standards (Grivas and Komar 2008). The potential users of practical 
guidelines, other recommendations, and protocols need to know how much 
confidence they can place in such recommendations. Protocols must be system- 
atically developed by panels of experts with access to the available evidence, an 
understanding of the problem and research methods, and sufficient time for 
reflection (Grade-Working-Group 2004) that the MEPROCS project provided. 
Some of the key elements of the methodology discussed in these guidelines are 
the fact that they were developed by a multidisciplinary group; they were based 
on a systematic review of the scientific evidence; and recommendations were 
linked to the supporting evidence and graded according to the strength of that 
evidence. 


10.3 Problems Encountered 


It is important to highlight that the achievements were reached after solving some 
problems encountered. The problems presented threats for the success of the project, 
but they were addressed in the following ways: 


° Ethical and legal issues to share data. Important legal and ethical issues were 
analyzed and addressed in order to share the data among the MEPROCS partic- 
ipants world-wide. In particular, two different forms were distributed to every 
data provider and data user. In the first form, the data provider certified the data 
release for scientific purposes, according to his national laws and ethical regula- 
tions/ethical committee/etc. This included a number of cases consisting of either 
ante-mortem photographs, laser-scans of the skull, x-rays of the skull, CTs of the 
skull, or any other. The data provider also certified that for the cases provided, the 
person had been positively identified via DNA/dental records/other. In the second 
form, the user was informed about the kind of material provided and the particular 
terms of use of such material. The user certified that he was the scientific lead 
from his institution for the MEPROCS project. Also, he certified that he could 
receive the scientific material for scientific purposes and accepted the previous 
terms of use and all the applicable regulations according to his national laws and 
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ethical regulations, ethical committees, etc. The particular templates of both 
forms can be found in Appendix C. 

° Technical issues to obtain ground-truth data. The precise projection of the skull 
onto a photograph of the same person is not a trivial task. After thorough analysis 
of the problem, the MEPROCS participants determined that the only chance to 
achieve it was using clinical data (which also involved an informed consent that 
the patient should sign to facilitate the data use). The particular procedure to 
obtain the ground truth included images resulting from orthostatic Cone-Beam 
CT processed to obtain the corresponding 3D face and 3D skull models. After 
positioning homologous points in both the 3D face model and the photograph of 
the patient, the former was automatically projected onto the latter to produce a 
perfect match. Then, the parameters were applied to the 3D skull model, resulting 
in a perfect SFO. The latter superimposition is considered a ground-truth 
skull-face overlay. A detailed explanation is given in Ibáñez et al. (2015). 

° Coordination difficulties. It was challenging to coordinate a large group of very 
renowned experts, researchers, and practitioners with different experiences and 
interests. The use of the technique is marginal in some countries, while it plays a 
crucial role in others. In order to overcome these difficulties, MEPROCS was 
always guided by the global aim to perform a scientific and objective approach to 
every single task of the project. In this sense, the role of the technical studies was 
essential. Also, the tireless efforts to reach global agreements that were only 
possible in face-to-face meetings should be emphasized. 

° Economic limitations. Initially, the MEPROCS consortium consisted of seven 
partners. The project activities and their corresponding budget were scaled 
according to this size. Though one of the objectives of the project was to involve 
new institutions, we did not expect the positive and proactive attitude of so many 
additional participants. This represented a great opportunity for international 
collaboration (which was the main aim of the project), but, at the same time, 
we had to properly manage our limited funds. We requested some modifications 
in the budget from the project officer in Brussels in order to respond to this new 
situation. The total amount of funds remained the same, but we proposed some 
changes among different items of the budget. Once approved by the European 
authorities, we could use the funds to organize six meetings (attended by 20 per- 
sons, average), one international workshop (attended by 30 delegates), and the 
final conference that supported the travel and accommodation expenses (together 
with bursaries for students) of more than 80 delegates. 

° Time constraints. Initially, the MEPROCS duration was 24 months. The appro- 
priate use of the original MEPROCS grant to support the activities of many more 
new institutions was not easy. Beyond that economical challenge, the involve- 
ment and active collaboration of an important number of new participants had an 
important impact on the MEPROCS schedule as well. The project became more 
ambitious because it was a great opportunity to launch new technical studies that 
were not originally planned. This situation was explained to the European 
authorities who approved the extension of the project for six additional months, 
considering the same funds initially granted for the project. Throughout this 
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period of time (30 months) and until the very last day, there was continuous work 
in the numerous tasks of the project with a special effort on the handbook. 


10.4 Future Trends and Research Propositions 


The diverse support received by the forensic community, together with the different 
interests and uses of the technique in different countries, and the significant differ- 
ences obtained in the reliability studies developed so far lead us to identify three 
main challenges in craniofacial superimposition for the future: 


° The need of a broader study on the evaluation criteria. MEPROCS suffered a 
limitation as far as the resources and materials employed to analyze the subjec- 
tivity and discriminative power of the different criteria for assessing the skull-face 
correspondence are concerned. This is a crucial aspect that deserves important 
attention in the future. The methodology followed in MEPROCS should lead to 
further studies involving significant numbers of participants evaluating a relevant 
number of cases. Some of the aims of such studies should be the selection of the 
more significant criteria and the connection of the criteria with the decision 
degrees included in the MEPROCS framework, that is, the estimation of the 
criteria that should be satisfied to support every decision degree. 

° The need of objective assessment and automation. Knowledge exchange and the 
possibility to improve existing approaches and propose new methods to solve 
problems are the main forces behind the evolution of science. The guarantee of 
objective procedures to evaluate the performance of those proposals is essential. 


To compare the performance of newly developed CFS methods, a common 
forensic dataset of known case studies should be available. In this way, the valida- 
tion of the methods proposed could be applied to solved cases and thus comparison 
of the results with the identification previously determined by forensic 
anthropologists. 

The absence of a common repository of solved CFS cases has limited the 
development of automatic methods that could solve some of the most tedious CFS 
tasks in a fast, accurate, reproducible, and objective way. To date, few automatic 
CFS tasks are used in practical applications despite the high number of cases 
examined and the large amount of time that the forensic expert spends in performing 
the examination. In particular, skull-face overlay was as a very challenging and time- 
consuming part of the craniofacial superimposition technique. Despite the existence 
of promising works in this direction, automatic techniques have not been 
implemented on a large scale due to the inability to test their performance in an 
objective manner. 

It is thus essential to obtain ground-truth data and there are a number of open 
problems related to use of Cone-Beam CTs (CBCTs). Since CBCTs are employed 
for maxillofacial treatments, the images’ acquisition field generally lacks the upper 
part of the head because it is useless for those purposes. Moreover, the inclusion of 
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the upper part of the head would represent a needless additional radiation of the 
patient. Nevertheless, that lack of information is a clear limitation for many cranio- 
facial superimposition tasks. In particular, this is an important shortcoming for the 
appropriate evaluation of the results. Furthermore, the segmentation of the available 
CBCT data to obtain only the bonny part of the whole medical image is another real 
challenge. There are plenty of artifacts typically from tooth fillings that really 
complicate this task. Also, CBCTs’ resolution is not as good as conventional CTs, 
which were discarded in MEPROCS ground-truth studies (Ibáñez et al. 2015), 
because the gravity could have an impact on the flesh that would invalidate the 
potential conclusions drawn from such data. 


° The need of a significantly large reliability study. Such a reliability study should 
take into consideration the two previous points. On the one hand, this crucial task 
was not faced in MEPROCS due to the lack of time. Therefore, the statistical 
basis for the use of the technique has not been produced by the studies conducted 
in MEPROCS. On the other hand, the reliability studies reported in the literature 
are fraught with limitations. The absence of an objective measure of the skull face 
overlay match, technical limitations of the equipment, disregard for accurate 
landmarks location while performing landmark based methods, absence of soft 
tissue data for the tested population, insufficient quality of the 3D cranial models, 
postmortem photographs, reduced samples, absence of appropriate statistical 
analysis, and the absence of inter- and intraobserver studies are just a few of 
such shortcomings. Statistically significant reliability studies that tackle the 
challenges identified in this manuscript are required to obtain a more solid picture 
on the reliability of craniofacial superimposition and its potential complementary 
role with other forensic sciences techniques. 


10.5 Concluding Remarks 


Most of the aforementioned future trends and research propositions can only be 
properly faced by a multidisciplinary team. After MEPROCS, we can conclude that 
many of the achievements were only possible thanks to the diverse consortium that 
consisted of forensic laboratories, police forces, and technical institutions. In partic- 
ular, the application of craniofacial superimposition requires an awareness of the 
technical implications related to imagery, discipline that is in continuous and fast 
technological development, especially with regard to three-dimensional images and 
interactivity. This technological trend may lead, in the near future, to new and more 
sophisticated imaging tools. These new tools will need to be carefully evaluated 
from time to time for their potential use in craniofacial superimposition. 

Objective and unbiased validation studies over a significant number of cases are 
required to get a more solid picture on craniofacial superimposition reliability. It will 
not be possible to compare the performance of existing and upcoming methods for 
craniofacial superimposition without a common forensic database available for the 
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research community. Skull-face overlay is a key task within craniofacial superim- 
position that has a direct influence on the subsequent task devoted to evaluate the 
skull-face relationships. Once legal and ethical issues are overcome to facilitate the 
public use, the creation of a database of skull-face overlay cases is a real need. 

Besides, new statistical and computational techniques should be devised based on 
the available data. Soft computing and computer vision should play an irreplaceable 
role in the evolution of the technique. 

In general, we can’t confirm that the current state of the technique is mature 
enough to be used as sole evidence for positive identification; however, we can 
confirm that those who follow the MEPROCS recommendations greatly improve 
their performance and have a better scientific basis. 
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Appendix A. Informed Consent Template 
Relating to Human Remains 


New methodologies and protocols of forensic identificotion 
by craniofacial superimposition(MEPROCS) 


MEPR&CS .2 BH 


INFORMED CONSENT TEMPLATE INSTRUCTIONS 


* Model Text is in bold and is generally required 

* Instructions are in ifalics 

* Indicates that the investigator should fill in the appropriate information. 

° If the template is downloaded, ensure all instructional comments are deleted or 
revised as appropriate. 


DELETE THIS BOX WHEN SUBMITTING CONSENT FORM 


NAME OF THE CENTRE WHERE THE STUDY IS GOING TO BE CARRIED 
OUT: 


CONSENT BY SUBJECT FOR PARTICIPATION IN A STUDY 


Identification Case Number: 
Name of Subject: 
Local Identification Number: 


STUDY TITLE: Semi-automatic Craniofacial Superimposition Results Validation 


Person Directing Study: 
Address: 
Telephone Number: 
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As the responsible party for the deceased, you are being asked to participate in a 
study involving the corpse. A member of the MEPROCS project team will explain 
what is involved in this study and how it will affect the remains of the deceased. This 
consent form describes the study procedures, the implications and benefits of 
participation, as well as how the deceased’s confidentiality will be maintained. 
Please take your time to ask questions and feel comfortable making a decision 
whether to participate or not. This process is called informed consent. If you decide 
to participate in this study, you will be asked to sign this form. 


WHY IS THIS STUDY BEING DONE? 


The purpose of this study is to provide a specific reliability index to the semi- 
automatic CFS method. This method is very useful for both the forensic anthropol- 
ogy community and Police Forces for the identification of unknown persons, 
together with other techniques or, on its own when there is not enough (ante- or 
post-mortem) information available to apply them. Craniofacial superimposition has 
been used for more than one century, contributing to the process of identification in 
many cases, especially in scenarios like mass disasters, terrorism, missing persons 
identification, and common grave investigation. However, there is lack of protocols 
and standards in the application of the technique and contradictory information 
concerning its reliability. The MEPROCS project aims to propose a common EU 
framework to allow the extensive application of the CFS technique in practical 
forensic identification scenarios commonly tackled by the European scientific police 
units, providing an objective evaluation of the forensic identification results 
achieved by CFS, avoiding particular assumptions that could bias the process. 


HOW MANY PEOPLE WILL TAKE PART IN THE STUDY 


About X people will take part in this study at the Name of the Centre and if 
applicable add and about Y people throughout the European Union. 


WHAT IS INVOLVED IN THE STUDY? 


The semi-automatic CFS system needs a 3D model of the skull of the deceased and 
one or more face photographs of the same person when he/she was alive. In order to 
obtain a reliable 3D model of the skull, flesh and hair have to be removed from the 
skull. Whenever a forensic anthropologist or scientific police involved in the project 
considers that a deceased individual could be useful for the project he/she will 
follow the informed consent process. 

During this study, [insert name] and [his/her] team will collect information about 
the deceased for the purposes of this research. Only medical images from the skull of 
the deceased and alive photographs of the face are required for carrying out this 
study. In addition information about race, sex and age will be needed in order to 
contextualize each study case. No more personal data is required. 


HOW LONG WILL I BE IN THE STUDY? 


The time required for the 3D digitisation process varies depending on the particular 
conditions of the body (ranging from some minutes to a few hours). Then, the body 
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of the deceased is not used any more. A 3D model of the skull will be filed in the 
deceased’s record and a codified copy will be used for the purposes of the study. This 
data will be used for the duration of the project and could also be useful for future 
research at a national or international level. 

[If applicable, include: ] 

[Insert PI name] may decide to take the deceased off the study without your 
consent if: 

[Include all that are applicable] 


° Other relatives do not agree with it. 
° If the study is stopped. 


WHAT ARE THE RISKS OF THE STUDY? 


The only risks derived from participation in the project are those related to the 
managing of personal information, but as it will be explained below confidentiality 
and privacy will be maintained as established in the Directive 95/46/EC. 


ARE THERE ANY BENEFITS TO TAKING PART IN THE STUDY? 


If you agree to take part in this study, there may not be a direct benefit to you. 
However, we hope the information learned from this study will benefit the global 
standardization of the technique, making the identification of deceased persons a 
faster and more reliable process. 


WHAT OTHER OPTIONS ARE THERE? 


Instead of being in this study, you have the option of not participating. MEPROCS 
members understand and respect your decision. 


WHAT ARE THE COSTS? 


There will be no costs to you or the deceased’s insurance company resulting from 
your participation in this study. 


WILL I BE PAID FOR MY PARTICIPATION? 
“You will not be paid to participate” 
WHAT ABOUT CONFIDENTIALITY? 


Study records that identify the deceased will be kept confidential. Skull and face 
images acquired from the deceased will be filed with the rest of the protected 
information in his/her personal record. Only authorized personnel can access this 
data. A copy of the skull and face images will be codified with a random number that 
does not allow their identification. A database will be created with files of the 
codified images that will not contain personal data that could lead to any person’s 
identification. These files will only include information about race, sex and age in 
order to carry out statistical studies. The data collected in this study will be used for 
the purpose described in the form. By signing this form, you are allowing the 
MEPROCS team of the corresponding Centre to access the codified images of the 
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deceased and to data related to his/her sex, race and age, but, they never could access 
any another personal data that allows his/her identification. The MEPROCS team 
includes the individuals listed on this consent form and other personnel involved in 
this study. 

Aspart of the study, [insert PIname] and [his/her] team will report the results of 
your study, related procedures and tests explained above to the European Centre for 
Soft Computing. These only include codified images under the right numeration and 
data related to race, age and sex. 

The project will be reviewed by regional or national Ethical Committees whose 
responsibility is to protect human subjects in research. 

Data from this study may be used in specialized publications or presentations. 
The deceased’s name and other identifying information will be removed before the 
data is used. 


WHAT ARE MY RIGHTS AS A PARTICIPANT? 


Taking part in this study is voluntary. 

If you choose to no longer be in the study and you do not want any of the 
deceased’s information to be used, you must inform [insert PI name] in writing at 
the address on the first page. 

[Include for all studies] 

You will be given a signed copy of this document. This consent form document 
does not have an expiration date. 


WHOM DO I CALL IF I HAVE QUESTIONS OR PROBLEMS? 


You have talked to (insert name of person conducting consent process) about this 
study and you have had the opportunity to ask questions concerning any and all 
aspects of the research. If you have further questions about the study, you may call 
(insert PI name and phone number). 

If you have any questions concerning your rights in this research study you may 
contact a MEPROCS ethical committee representative at this institution. 


SUBJECT 


The study and the procedures associated with it have been explained to me. I will 
receive a signed copy of this consent form for my records. 

As a person responsible for the deceased I agree that the MEPROCS team may 
use the skull and information of the deceased that I am responsible for in their study. 
I made this decision freely and I do not have to sign this form if I do not want to be 
part of this study. 


Signature of Responsible: 
Date: Time: AM/PM (circle) 
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PERSON OBTAINING CONSENT 


I have explained to insert name of subject/parent/guardian the nature and purpose 
of the study and the risks involved. I have answered and will answer all questions to 
the best of my ability. I will give a signed copy of the consent form to the subject 
[and if appropriate add] and family. 


Signature of Person Obtaining Consent: 
Date: Time: AMF/PM (circle) 


FORENSIC ANTHROPOLOGIST/SCIENTIFIC POLICE: 


Signature of Forensic Anthropologist/Scientific Police: 
Date: Time: AM/PM (circle) 


PROXY/SURROGATE CONSENT: 


The subject on whose behalf I consent has no legally authorized representative or 
that person is unavailable despite efforts to contact him/her. I believe my proxy 
decision on behalf of the subject conforms as closely as possible to what the subject 
would have done or intended under the circumstances. This decision takes into 
account what I believe are the subjects’ personal, philosophical, religious and/or 
moral beliefs and ethical values relative to the purpose of life, sickness, medical 
procedures, suffering and death. These issues have been discussed by the doctors 
directing this research and myself. 


Signature of Individual Providing Surrogate consent: 
Relationship to Subject: 
Date: Time: AM/PM (circle) 


Appendix B. Informed Consent Template 
Regarding Data Collection from Living 
Individuals 


New methodologies and protocols of forensic identification 
by craniofacial superimposition(MEPROCS) 


MEPR£CS .Z EH 


INFORMED CONSENT TEMPLATE INSTRUCTIONS 


* Model Text is in bold and is generally required 

° Instructions are in italics 

* Indicates that the investigator should fill in the appropriate information. 

° If template is downloaded, ensure all instructional comments are deleted or 
revised as appropriate. 


DELETE THIS BOX WHEN SUBMITTING CONSENT FORM 


NAME OF THE CENTRE WHERE THE STUDY IS GOING TO BE CARRIED 
OUT 


CONSENT BY SUBJECT FOR PARTICIPATION IN A STUDY 


Identification Case Number: 
Name of Subject: 
Local Identification Number: 


STUDY TITLE: Semi-automatic Craniofacial Superimposition Results Validation 


Personal Directing Study: 
Address: 
Telephone Number: 
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You are being asked to participate in a research project. A member of the MEPROCS 
project team will explain what is involved in this study. This consent form describes 
the study procedures, the implications and benefits of participation, as well as how 
confidentiality will be maintained. Please take your time to ask questions and feel 
comfortable in making a decision whether to participate or not. This process is called 
informed consent. If you decide to participate in this study, you will be asked to sign 
this form. 


WHY IS THIS STUDY BEING DONE? 


The purpose of this study is to provide a specific reliability index to the semi- 
automatic CFS method. This method is very useful for both the forensic anthropol- 
ogy community and Police Forces for the identification of unknown persons, 
together with other techniques or, on its own when there is not enough (ante- or 
post-mortem) information available to apply them. CFS has been used for more than 
one century, contributing to the process of identification in many cases, especially in 
scenarios like mass disasters, terrorism, missing persons identification, and common 
grave investigation. However, there is lack of protocols and standards in the appli- 
cation of the technique and contradictory information concerning its reliability. The 
MEPROCS project aims to propose a common EU framework to allow the extensive 
application of the CFS technique in practical forensic identification scenarios com- 
monly tackled by the European scientific police units, providing an objective 
evaluation of the forensic identification results achieved by CFS, avoiding particular 
assumptions that could bias the process. 


HOW MANY PEOPLE WILL TAKE PART IN THE STUDY? 


About X people will take part in this study at the Name of the Centre and if 
applicable add and about Y people throughout the European Union. 


WHAT IS INVOLVED IN THE STUDY? 


The semi-automatic CFS system needs a 3D model of the skull of the individual and 
one or more face photographs of the same living person. Whenever a forensic 
anthropologist or scientific police involved in the project considers that an individ- 
ual could be useful for the project he/she will follow the informed consent process. 

During this study, [insert name] and [his/her] team will collect information about 
the individual for the purposes of this study. Only medical images of the skull and 
living photographs of the face are required for carrying out this study. In addition, 
information about race, sex and age will be needed in order to contextualize each 
study case. No more personal data is required. 


HOW LONG WILL I BE IN THE STUDY? 


The time required for the 3D digitisation varies, but could range from 5-30 minutes. 
A 3D model of the skull will be filed in the participant's record and a codified copy 
will be used for the study purpose. This data will be used for the duration of the 
project and could be also useful for future research at a national or international 
level. 
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[If applicable, include:] 
[Insert PI name] may decide not to use this data without your consent if the study 
is stopped. 


WHAT ARE THE RISKS OF THE STUDY? 


The only risks derived from the participation in the project are those related to the 
managing of personal information, but as it will be explained below confidentiality 
and privacy will be maintained as established in the Directive 95/46/EC. 


ARE THERE ANY BENEFITS TO TAKING PART IN THE STUDY? 


If you agree to take part in this study, there may not be a direct benefit to you. But, 
we hope the information learned from this study will benefit the global standardiza- 
tion of the technique, making identifications of the deceased a faster and more 
reliable process. 


WHAT OTHER OPTIONS ARE THERE? 


Instead of being in this study, you have the option of not participating. MEPROCS 
members understand and respect your decision. 


WHAT ARE THE COSTS? 

There will be no costs to you resulting from your participation in this study. 
WILL I BE PAID FOR MY PARTICIPATION? 

“You will not be paid to participate” 

WHAT ABOUT CONFIDENTIALITY? 


Study records that identify the individual will be kept confidential. Skull and face 
images acquired from the individual will be filed with the rest of the protected 
information in his/her personal record. Only authorized personnel can access this 
data. A copy of the skull and face images will be codified with a random number that 
does not allow their identification. A database will be created with files of the 
codified images that will not contain personal data that could lead to any person’s 
identification. These files will only include information about race, sex and age in 
order to carry out statistical studies. The data collected in this study will be used for 
the purpose described in the form. By signing this form, you are allowing the 
MEPROCS team of the corresponding Centre to access your codified images and 
to data related with your sex, race and age, but they never could access other 
personal data that allows your identification. The MEPROCS team includes the 
individuals listed on this consent form and other personnel involved in this study. 
As part of the study, [insert PI name] and [his/her] team will report the results of 
your study, related procedures and tests explained above to the European Centre for 
Soft Computing. These only include codified images under the right numeration and 
data related to race, age and sex. The project will be reviewed by regional or national 
Ethical Committees whose responsibility is to protect human subjects in research. 
Data from this study may be used in specialized publications or presentations. The 
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individual's name and other identifying information will be removed before this data 
is used. 


WHAT ARE MY RIGHTS AS A PARTICIPANT? 


Taking part in this study is voluntary. If you choose to no longer be in the study and 
you do not want any of your information to be used, you must inform [insert PI 
name] in writing at the address on the first page. 

[Include for all studies] 

You will be given a signed copy of this document. This consent form document 
does not have an expiration date. 


WHOM DO I CALL IF I HAVE QUESTIONS OR PROBLEMS? 


You have talked to (insert name of person conducting consent process) about this 
study and you have had the opportunity to ask questions concerning any and all 
aspects of the research. If you have any further questions about the study, you may 
call (insert PI name and phone number). 

If you have any questions concerning your rights in this research study you may 
contact a MEPROCS ethical committee representative at this institution. 


SUBJECT 


The study and the procedures associated with it have been explained to me. I will 
receive a signed copy of this consent form for my records. 

I agree that the MEPROCS team may use my images and information in their 
study. I made this decision freely and I do not have to sign this form if I do not want 
to be part of this study. 


Signature of Responsible: 
Date: Time: AM/PM (circle) 


PERSON OBTAINING CONSENT 


I have explained to insert name of subject/parent/guardian the nature and purpose 
of the study and the risks involved. I have answered and will answer all questions to 
the best of my ability. I will give a signed copy of the consent form to the subject 
[and if appropriate add] and family. 


Signature of Person Obtaining Consent: 
Date: Time: AMF/PM (circle) 


FORENSIC ANTHROPOLOGIST/SCIENTIFIC POLICE: 


Signature of Forensic Anthropologist/Scientific Police: 
Date: Time: AMF/PM (circle) 


Appendix C. Informed Consent Form for 
Scientific Material Sharing 


New methodologies and protocols of forensic identification 
by craniofacial superimposition(MEPROCS) 


MEPR&CS .2 EH 


Name: 


Affiliation: 
Qualification: 
Country: 


STUDY TITLE: Semi-automatic Craniofacial Superimposition Results Validation 
WHY IS THIS STUDY BEING DONE? 


The purpose of this study is to provide a specific reliability index to the semi- 
automatic CFS method. This method is very useful for both the forensic anthropol- 
ogy community and Police Forces for the identification of unknown persons, 
together with other techniques or, on its own when there is not enough (ante- or 
post-mortem) information available to apply them. CFS has been used for more than 
one century, contributing to the process of identification in many cases, especially in 
scenarios like mass disasters, terrorism, missing persons identification, and common 
grave investigation. However, there is a lack of protocols and standards in the 
application of the technique and contradictory information concerning its reliability. 
The MEPROCS project aims to propose a common EU framework to allow the 
extensive application of the CFS technique in practical forensic identification sce- 
narios commonly tackled by the European scientific police units, providing an 
objective evaluation of the forensic identification results achieved by CFS, avoiding 
particular assumptions that could bias the process. 
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This study material includes: 


1. Human remains, collected after obtaining informed consent from the responsible 
party for the deceased; 

2. Data collecting from living individuals, who decide to participate in this study, 
after being properly informed and giving their consent; 

3. Human remains shared by institutions in which they have been stored for more 
than 15 years, and whose national laws allow their use after this period of time. 
This informed consent is addressed specifically to this third group. 


I hereby certify that I can release for scientific purposes, according to our national 
laws and ethical regulations/ethical committee/etc., information and images 
concerning case/process number 


of our series, consisting of: 


— ante-mortem photos 

— pictures of the skull, number 
— laser scans of the skull 

— xrays 

— ct scans 

— other: 


I also certify that for case/process number 


the person the skull belongs to, has been positively identified via DNA/dental 
records/other, and therefore that the ante-mortem images do belong to the case. 


Sincerely 


Date: Signature: 
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